-- Logs begin at Tue 2022-08-23 21:13:45 UTC, end at Tue 2022-08-23 22:47:13 UTC. -- Aug 23 22:10:48.172655 dv-osbrick-849840-7-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 22:10:48.181996 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:10:48 2022] *** Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: nodename: dv-osbrick-849840-7-ceph Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: machine: x86_64 Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: clock source: unix Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: pcre jit disabled Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: detected number of CPU cores: 4 Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: current working directory: / Aug 23 22:10:48.184634 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: your processes number limit is 47680 Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: your memory page size is 4096 bytes Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: detected max file descriptor number: 2048 Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: lock engine: pthread robust mutexes Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: thunder lock: enabled Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 22:10:48.185580 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:10:48.234767 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: Python main interpreter initialized at 0x5653b1d5b9c0 Aug 23 22:10:48.234767 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: python threads support enabled Aug 23 22:10:48.234767 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: your server socket listen backlog is limited to 100 connections Aug 23 22:10:48.234767 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:10:48.235303 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:10:48.235303 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: *** Operational MODE: preforking *** Aug 23 22:10:48.235627 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:10:48.235627 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: spawned uWSGI master process (pid: 88940) Aug 23 22:10:48.235870 dv-osbrick-849840-7-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 22:10:48.237508 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: spawned uWSGI worker 1 (pid: 88941, cores: 1) Aug 23 22:10:48.237508 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: spawned uWSGI worker 2 (pid: 88942, cores: 1) Aug 23 22:10:48.237508 dv-osbrick-849840-7-ceph devstack@keystone.service[88940]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:10:53.696718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:10:53.696718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: from cryptography.utils import int_from_bytes Aug 23 22:10:53.698065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:10:53.698065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: from cryptography.utils import int_from_bytes Aug 23 22:10:53.704751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:10:53.704751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: from cryptography.utils import int_from_bytes Aug 23 22:10:53.705767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:10:53.705767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: from cryptography.utils import int_from_bytes Aug 23 22:10:53.758125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:10:53.758362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:10:53.758501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:10:53.758697 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:10:53.758815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] command line args: [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:10:53.758932 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] command line args: [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:10:53.759030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:10:53.759030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ================================================================================ {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:10:53.759226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:10:53.759226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ================================================================================ {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:10:53.759411 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] admin_token = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.772732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] admin_token = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] config_dir = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] config_dir = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] config_source = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] debug = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773826 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] config_source = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.773826 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] debug = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.774054 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.774391 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.774598 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.774759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.774914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.775989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.776121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.776121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_config_append = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.776431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_config_append = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.777436 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.777436 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_dir = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.777721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.777850 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_file = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.777965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_dir = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_file = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778462 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.778989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779467 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779746 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.779988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780229 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.780986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781325 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781887 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.781887 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] publish_errors = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] publish_errors = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782589 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782746 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.782891 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.783900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] standard_threads = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784050 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784384 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] standard_threads = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784743 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784743 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] use_journal = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.784963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] use_json = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] use_stderr = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] use_journal = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785614 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] use_syslog = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785731 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] use_json = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.785731 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] use_stderr = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.786037 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.786141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] use_syslog = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.786245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.786348 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:10:53.786459 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.786577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.786695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.786799 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.786902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787209 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787691 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.787908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788890 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.788999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.789923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790382 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790382 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.790932 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791043 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.791873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.792070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.792806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.792934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793192 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793573 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.793905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794218 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.794818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795710 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.795934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.796882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797011 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797133 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797763 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.797883 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798001 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798133 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.798946 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799207 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799461 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.799945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800320 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800700 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.800947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801191 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801812 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.801939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802419 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802561 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.802938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.803879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804726 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804829 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.804927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805121 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805121 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805749 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805749 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.805950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806879 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.806990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807633 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.807981 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.808987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809766 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.809875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810561 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810677 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.810912 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.811908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812376 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812506 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.external = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.external = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.812980 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813400 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813532 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813648 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.password = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.password = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.813878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] auth.token = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] auth.token = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814247 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814482 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814843 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.814979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815202 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.815977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816308 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816424 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816556 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.816788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817494 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.817947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.818899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819019 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819368 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819506 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.819882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820244 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820606 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820719 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.820954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821435 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821669 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.821921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822156 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822276 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.822884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823013 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823386 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823716 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.823983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.829872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.829872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830241 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830867 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.830969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831158 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831869 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.831989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832107 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832233 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832474 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832803 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.832919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.833996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834227 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834575 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.834910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835029 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835285 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.835942 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836196 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.836895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837146 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837392 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837519 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.837966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838723 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.838849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.839616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.839749 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.839892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840015 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840387 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840510 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.840851 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.841949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842208 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842346 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.842977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843101 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843222 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843698 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.843942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844564 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844689 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.844948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845191 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845562 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845825 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.845944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846615 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846735 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.846989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847113 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847579 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.847953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848565 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848743 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.848981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.849908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850032 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850032 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850550 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850665 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.850989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.851905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852848 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.852942 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] role.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853334 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] role.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.853811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854011 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] role.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854453 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854561 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] role.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.854725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855726 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.855916 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856101 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856233 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856531 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856633 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856821 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.856937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857435 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857649 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.857956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858562 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.858983 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859288 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.859962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860499 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.860919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861019 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.861925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862878 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.862975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863182 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863393 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863520 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863732 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863831 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.863947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864547 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864648 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.connection = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.864977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865384 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.865963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.connection = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.866788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867461 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867843 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.867955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868062 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868275 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.868966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:10:53.869261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:10:53.880937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.881221 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.881424 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.882133 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.882369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.882599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.890939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.892332 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.923424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.923707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.923840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.923997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.981630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:53.982151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.035312 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.035589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.039669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.039900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.135333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.135720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.136548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.136688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.136903 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137561 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137704 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.137893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.138236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.182807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.183776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.183776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184453 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184867 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.184999 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.185133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.185265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.185412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.206726 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.215356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.223436 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.223704 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.223934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.224157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.224379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.224595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.224812 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88941) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.237441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.237842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.238247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.238643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.239037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.239428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.239871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88942) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:10:54.244986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.247189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.247656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.257280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.257578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.257852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.258144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.259524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.259877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:10:54.260481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.260927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:10:54.261458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.261873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.262295 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.262724 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.271970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.277178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.277624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.278074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.278524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.278983 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.279411 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.279871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.280308 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.280495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.290389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.290623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.290758 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.290907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.291045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.291190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.295108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.300299 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.300761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.301206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.301662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.302120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.302537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.302977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.303421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.303926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.304167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.304523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.325245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.327857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.328314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.331181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.332815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.333169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.336381 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.336800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.337402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.337811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.338105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.338390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.345601 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.345893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.349136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.349546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.349972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.350268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.350556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.350853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.351143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.351581 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.351857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.352134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.357096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.357560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.357989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.358600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.359049 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.359512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.359959 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.360404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.368441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.368735 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.373366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.376519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.376821 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.381208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.384483 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.388166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.388320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.388482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.388778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.388941 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.389064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.389397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.389518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.396513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.402124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.402755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.405368 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.405676 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.405962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.406231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.410327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.413059 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.414751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.415027 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.415925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.418303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.418646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.418956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.419245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.419564 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.421968 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.422445 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.422878 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.423532 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.423971 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.424402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.430928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.431223 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.431542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.431823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.432107 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.432383 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.432663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.448967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.451896 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.453627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.454079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.454500 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.454930 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.455076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.456427 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.458025 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.458428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.458583 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.465780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.467309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.467942 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.470449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.470742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.470829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.471036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.471166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.471339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.475899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.476342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.476774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.477228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.477703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.481125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.481430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.481721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.488662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88942) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.489073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.489365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.489647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.489930 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.490215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.490507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.490811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.491076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.491351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.491655 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.491916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.492206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.492481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88942) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.500783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.501259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.501700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.502123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.502565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.503018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.503444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.525571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653b1d5b9c0 pid: 88942 (default app) Aug 23 22:10:54.529951 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5c77-c7e0-43c7-8586-d6efefb4fe44 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:54.530239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5c77-c7e0-43c7-8586-d6efefb4fe44 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:54.530513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5c77-c7e0-43c7-8586-d6efefb4fe44 None None] PATH_INFO: `/v3` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:54.531449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.534973 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Tue Aug 23 22:10:54 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:54.536546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.541738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.544853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.547409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.547871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.548335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.560681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.563310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.568459 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.568927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.569372 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.569789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.584391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.584874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.585293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.598578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88941) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:10:54.599201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.599671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.600143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.600575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.601009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.601455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.601866 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.602294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.602760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.603190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.603620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.604083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.604515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88941) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:10:54.675667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653b1d5b9c0 pid: 88941 (default app) Aug 23 22:11:04.104104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:04.104969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:04.105136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:04.107134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:04.121423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:04.121997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:04.122272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:04.257553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: INFO dbcounter [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] Registered counter for database keystone Aug 23 22:11:04.289407 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG oslo_db.sqlalchemy.engines [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:11:04.297924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writer thread running {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:11:04.508126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG passlib.handlers.bcrypt [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88941) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:11:04.508441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG passlib.handlers.bcrypt [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88941) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:11:04.566477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:04.568270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:04.732271 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:11:05.250003 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:05.329496 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: INFO dbcounter [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] Registered counter for database keystone Aug 23 22:11:05.349616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG oslo_db.sqlalchemy.engines [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:11:05.357116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writer thread running {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:11:05.483274 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa151d-ebee-476f-a4db-11cd35fd4b2a None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:05.487904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:05.488543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:05.488819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:05.489090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:05.498450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:05.552832 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:11:05.553085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77bdc6d-4662-442e-9636-e8f820c6691a admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:05.564582 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Aug 23 22:11:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:11:05.571066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:05.587388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3c83-ae6b-4543-ac20-88080ca0eb74 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:05.594025 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:05.595202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:05.595496 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:05.595788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] PATH_INFO: `/v3/projects/91d06c9416144a16ae9ac55e441f6e94` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:05.597741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] RBAC: Authorizing `identity:get_project(project_id=91d06c9416144a16ae9ac55e441f6e94)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:05.650844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:11:05.651189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411577c-0493-4d3e-83c7-b0b2d1251de8 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:05.656457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 2/5] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Aug 23 22:11:05 2022] GET /identity/v3/projects/91d06c9416144a16ae9ac55e441f6e94 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:08.621499 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f21a-530f-4bb0-8ab0-813a330cb9e8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:08.622027 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f21a-530f-4bb0-8ab0-813a330cb9e8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:08.622027 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f21a-530f-4bb0-8ab0-813a330cb9e8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:08.626354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 4/6] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:08.632148 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:08.632829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:08.633059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:08.653970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:08.655529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:08.663681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 22:11:09.000136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8f21a-530f-4bb0-8ab0-813a330cb9e8 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:09.014007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8f21a-530f-4bb0-8ab0-813a330cb9e8 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:09.019103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:09.019812 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:09.020132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:09.020766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:09.030215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:09.032123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863517-0747-4de6-a52c-b511a045d93a admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:09.044111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Aug 23 22:11:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:11:09.050911 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:09.061294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a7ce-5acb-46da-84c2-de1559464a0c None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:09.066969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:09.067666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:09.067949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:09.068223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:09.069573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:09.071429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc449968-4627-4cc3-92c3-a16d96e98bb8 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:09.073049 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 4/9] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Aug 23 22:11:09 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:11.551784 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ac34-a622-45d2-8d86-15f1c98c9fd0 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.552386 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ac34-a622-45d2-8d86-15f1c98c9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.552711 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332ac34-a622-45d2-8d86-15f1c98c9fd0 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.555329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:11.563097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085777f-d068-4436-84a6-7dc4801566ae None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.563687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085777f-d068-4436-84a6-7dc4801566ae None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.564030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085777f-d068-4436-84a6-7dc4801566ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.586304 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-f085777f-d068-4436-84a6-7dc4801566ae None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:11.588190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-f085777f-d068-4436-84a6-7dc4801566ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:11.685569 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 5/11] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:11.701214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150a65-cd21-4014-a4de-a99432ea0155 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.701653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150a65-cd21-4014-a4de-a99432ea0155 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.702088 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af150a65-cd21-4014-a4de-a99432ea0155 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.704442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 7/12] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:11.712235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.712631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.712998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.740163 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:11.741939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:11.766334 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:11.838965 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 6/13] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:12.023603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150a65-cd21-4014-a4de-a99432ea0155 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.205941 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.227199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af150a65-cd21-4014-a4de-a99432ea0155 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.272847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.273620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.273999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.274343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.322227 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c4b8-1f04-447c-a125-25ff6f67a144 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.327887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:12.363186 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.363992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.364621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.364756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.364892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.365174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.379478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:12.388823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:12.391215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:12.392343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:12.397380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.421264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:12.501577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 8/15] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:11:12.507864 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.610415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:12.652610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c328aa-85bb-46d6-94cb-547d973c9d1a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.656404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cac51-b01e-4f20-a2b4-9327a712f277 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.694134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.695136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.695511 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.695785 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.699945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.700569 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.700842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.701111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.701790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:12.702089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.703597 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.717087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 8/16] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:12.717985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.719567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.724566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:11:12.753741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:12.755129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:11:12.760068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:11:12.760068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:12.760068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:12.760068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:12.762930 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.845905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:12.891439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217f6a-d13d-4bba-85fd-35bb357e7708 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.937140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.937785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.938059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.938327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.939513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.941015 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.942617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:12.950882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.994658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3d1-ac28-4c8f-bb0b-dc24622c4cd4 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:13.023136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:13.032576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:13.033198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:13.033478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:13.033752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:13.034412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:13.034716 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:13.036155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:13.055380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:13.087773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d03-08ce-4b7e-b3da-8fe8f568f393 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:13.132229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:13.133046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:13.133334 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:13.133607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:13.134853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:13.136806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb06d84-36f3-4335-87ca-0ad690097f79 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:13.138503 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:13.145367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:13.269791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219596dd-1f3f-40cd-b1ce-8f5e3aa853c1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:13.307151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:13.307885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:13.308166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:13.308476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:13.309203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.domain.id=default, user.id=ed7003dd4df247c4b85cea0f6834c0c9) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:13.309509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:13.310964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f0c1-a281-45bd-8e79-2301acd4c3a7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:13.319948 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1322 bytes} [Tue Aug 23 22:11:13 2022] GET /identity/v3/role_assignments?user.id=ed7003dd4df247c4b85cea0f6834c0c9&scope.domain.id=default&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:16.359697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0dd-9dbf-4b64-81da-0f4fbf647d32 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:16.360752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0dd-9dbf-4b64-81da-0f4fbf647d32 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:16.361227 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579d0dd-9dbf-4b64-81da-0f4fbf647d32 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:16.362981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:16.369128 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:16.370261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:16.370736 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:16.406513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG passlib.handlers.bcrypt [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88942) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:11:16.407302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG passlib.handlers.bcrypt [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88942) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:11:16.485247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:16.488297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-40e9f4b1-794a-46fb-9d1d-df9fa6823b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:16.591992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:16.625681 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 12/23] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:16.903725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3080de-8fc3-46b7-b1c3-ce84a4944ff2 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:16.904107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3080de-8fc3-46b7-b1c3-ce84a4944ff2 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:16.904337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3080de-8fc3-46b7-b1c3-ce84a4944ff2 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:16.905709 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:16.912493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d78c-f19c-4b8f-aa9e-11b435b87ff0 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:16.913106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d78c-f19c-4b8f-aa9e-11b435b87ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:16.913578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d78c-f19c-4b8f-aa9e-11b435b87ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:16.941279 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4df4d78c-f19c-4b8f-aa9e-11b435b87ff0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:16.942873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4df4d78c-f19c-4b8f-aa9e-11b435b87ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:17.053518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 13/25] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:17.265441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f25d-db03-4796-bf47-dc025258e584 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.266144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f25d-db03-4796-bf47-dc025258e584 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.266621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62f25d-db03-4796-bf47-dc025258e584 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.268917 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 13/26] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:17.280879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.281492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.281959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.325761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:17.327353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:17.358023 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f25d-db03-4796-bf47-dc025258e584 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:17.382721 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:17.494189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:17.549364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62f25d-db03-4796-bf47-dc025258e584 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:17.603111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:17.603798 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.604078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.604446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.614489 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:17.636802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-945c82e3-e4c8-4cdb-bfdc-7c401c970b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:17.648357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:17.649358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:17.650393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:17.653402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 14/28] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:17.660780 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867f55-999c-4f46-a249-0b784217fd0d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.661497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867f55-999c-4f46-a249-0b784217fd0d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.661946 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be867f55-999c-4f46-a249-0b784217fd0d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.663851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 15/29] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:17.664737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be867f55-999c-4f46-a249-0b784217fd0d None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:17.725859 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:17.825303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7e2db-27ee-4c86-b997-f432f690e426 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:17.857528 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:17.884311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:17.885127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.885504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.886467 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.887476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:17.889349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:17.914390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be867f55-999c-4f46-a249-0b784217fd0d None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:17.966672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:17.967982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.968435 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.968851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.969790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:17.970242 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:17.971981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5e407-3d50-49f9-8a60-a1fa65b3bd75 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:17.983473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 16/30] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:17.984994 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.985424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.985839 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.006388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:18.008014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:18.086770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 17/31] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:18.094492 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.161717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 15/32] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:17 2022] POST /identity/v3/roles => generated 225 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:18.163014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.207059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.301899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098829-f582-4cfe-a27b-9c6fd309b29e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.374175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.374752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.375035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.375310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.385481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.390788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.392547 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.392667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e725f3b-1051-4b30-9aac-41667fe6b841 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-379aa569-1b36-488d-bcef-09cff5335683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:11:18.411505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:18.412626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:11:18.413637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:11:18.413637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:11:18.413637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:18.418830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 18/33] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:18.420409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f9e1-00ab-492f-879d-9a6522b30d52 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.420682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f9e1-00ab-492f-879d-9a6522b30d52 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.420997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366f9e1-00ab-492f-879d-9a6522b30d52 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.422801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 19/34] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:18.424165 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3119-c211-4825-a600-ae2b129eed43 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.424454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3119-c211-4825-a600-ae2b129eed43 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.424730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df3119-c211-4825-a600-ae2b129eed43 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.430746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 20/35] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:18.431776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df3119-c211-4825-a600-ae2b129eed43 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.470745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.472135 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.472781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.473266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.477256 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.481085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fcf37-8d41-476c-a5dc-26a9d3566b44 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.484922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 16/36] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:18.492582 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78d2a4-4e38-4a47-879f-2750e58462e8 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.493000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78d2a4-4e38-4a47-879f-2750e58462e8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.493224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78d2a4-4e38-4a47-879f-2750e58462e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.523054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-ea78d2a4-4e38-4a47-879f-2750e58462e8 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:18.524762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-ea78d2a4-4e38-4a47-879f-2750e58462e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:18.588017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df3119-c211-4825-a600-ae2b129eed43 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.606637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.628678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 17/37] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:18.630001 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.630297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.630575 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.634828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.636502 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.637201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.637813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.638680 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:18.639184 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.641050 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.653064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:18.654539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:18.677527 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 21/38] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:18.680098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.775917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 18/39] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:18.777140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.811829 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.865494 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5ab1-b24a-45a5-9180-1da80aeb6603 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.901059 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf6a8-aad6-4066-b893-ae52ac09fe97 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.942613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.943394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.943858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.944293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.945070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.946634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.947271 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.948717 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.949657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.950321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.952492 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.956273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.960112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 22/40] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:18.962792 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.015596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.083914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 19/41] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:18 2022] POST /identity/v3/projects => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:19.085081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.102349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff8c3-92fb-4b14-8f16-9a2d4d11ce2e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.172264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.172995 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.173318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.173618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.174744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.177074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.229264 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.252481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec6284-c2c9-4851-ac16-5b6afacc31ae None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.296722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.297523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.297853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.298202 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] PATH_INFO: `/v3/domains/default/users/ed7003dd4df247c4b85cea0f6834c0c9/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.300715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ed7003dd4df247c4b85cea0f6834c0c9, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.303186 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.406320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 20/42] 10.222.0.50 () {58 vars in 1361 bytes} [Tue Aug 23 22:11:19 2022] PUT /identity/v3/domains/default/users/ed7003dd4df247c4b85cea0f6834c0c9/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:19.407294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.410053 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 23/43] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:18 2022] POST /identity/v3/roles => generated 219 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:19.411090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.579043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c84ba-694d-4bc9-8b0d-121d96e6e51e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.581335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.622272 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6262b36-4009-4814-8f2a-2132403b4a22 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.642835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.644476 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.645051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.645857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.648129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.650954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.655356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 24/44] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:19.666225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.684797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.686406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.686726 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.687039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.688254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.694873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a491bff-d310-477b-b986-ad27375d573e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.801127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671c309-87d3-42c9-a517-043a0dccc533 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.817937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.824184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 21/45] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Aug 23 22:11:19 2022] POST /identity/v3/roles => generated 223 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:19.844419 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.845034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.845322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.845597 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.846272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.847863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013777e7-e73d-4f82-9b9a-d3dc15c705b1 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.961322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 25/46] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:19 2022] POST /identity/v3/projects => generated 312 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:21.779984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b1f-8866-4248-add9-8be11287ca1b None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:21.780577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b1f-8866-4248-add9-8be11287ca1b None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:21.780577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b1f-8866-4248-add9-8be11287ca1b None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:21.781909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 22/47] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:21.787799 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b62a-53be-4ae8-af30-26a5db606499 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:21.788305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b62a-53be-4ae8-af30-26a5db606499 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:21.788397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b62a-53be-4ae8-af30-26a5db606499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:21.807990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5292b62a-53be-4ae8-af30-26a5db606499 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:21.809510 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5292b62a-53be-4ae8-af30-26a5db606499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:21.827011 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:21.882835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 26/48] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:22.217930 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf38b1f-8866-4248-add9-8be11287ca1b None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.319232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb39f-8b2a-4c7a-b285-fc41d702a001 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.319580 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb39f-8b2a-4c7a-b285-fc41d702a001 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.319863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb39f-8b2a-4c7a-b285-fc41d702a001 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.321229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 27/49] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:22.327591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.327916 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.330692 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.339710 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf38b1f-8866-4248-add9-8be11287ca1b None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:22.347569 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:22.348773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:22.376758 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:22.377398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.377678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.377958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.391569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:22.397957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:22.399070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:22.400300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 23/50] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:22.405952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.425463 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 28/51] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:22.470146 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:22.514791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e78c9-dd0e-43cf-a189-86a41cecc725 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:22.560907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:22.561513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.561790 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.562063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.562731 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:22.563034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:22.564449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:22.579530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 24/52] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:22.585090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.684423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:22.707408 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813b349-f4ec-4a20-92d5-d373bb6443be None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:22.748388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:22.748931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.749209 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.749478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.750704 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:22.752248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:22.753904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 29/53] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:22.759513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.767657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.879113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9561726-de77-4292-9e3e-84f20448c003 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:22.879730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261e37e-8d27-41e0-805e-7d635f6caf60 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:22.907427 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:22.920732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:22.921396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.921679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.922014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.922399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:22.923061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:22.923239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:22.923335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:22.923622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:22.924768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:22.924950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:22.926655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:22.926783 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 25/54] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:22.928245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 30/55] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:22.932569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.934557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:22.955073 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:23.041713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a58d25-8056-4d5d-8c5e-d543cdc31649 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:23.046970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df39d-a83b-42fa-89f2-561c24388c12 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:23.078112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:23.078824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:23.079006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:23.079286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:23.080284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.domain.id=default, user.id=ed7003dd4df247c4b85cea0f6834c0c9) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:23.080594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:23.082087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35415c0-ae16-4d93-8d4b-4de942d89a22 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:23.084318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:23.084980 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:23.085261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:23.085530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:23.086168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:23.087641 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d9bf-2a22-4d94-963c-2424e7b38f99 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:23.088438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 26/56] 10.222.0.50 () {56 vars in 1322 bytes} [Tue Aug 23 22:11:22 2022] GET /identity/v3/role_assignments?user.id=ed7003dd4df247c4b85cea0f6834c0c9&scope.domain.id=default&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:23.237681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 31/57] 10.222.0.50 () {60 vars in 1140 bytes} [Tue Aug 23 22:11:22 2022] POST /identity/v3/projects => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:25.466344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199695c-52b7-4841-9f11-ebe1b0515ac7 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:25.466864 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199695c-52b7-4841-9f11-ebe1b0515ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:25.466968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199695c-52b7-4841-9f11-ebe1b0515ac7 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:25.468544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 27/58] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:25.473960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be025069-6a89-4891-a017-fe953f387c64 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:25.474349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be025069-6a89-4891-a017-fe953f387c64 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:25.474506 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be025069-6a89-4891-a017-fe953f387c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:25.493104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-be025069-6a89-4891-a017-fe953f387c64 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:25.494277 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-be025069-6a89-4891-a017-fe953f387c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:25.556002 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:25.560640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 32/59] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:25.901230 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199695c-52b7-4841-9f11-ebe1b0515ac7 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:25.960824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:26.007718 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199695c-52b7-4841-9f11-ebe1b0515ac7 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:26.041923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:26.042552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:26.042831 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:26.043103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:26.044305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:26.045766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9642bf-eed9-484a-a6f2-6d978f48fbbf None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:26.047334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 28/60] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:26.053054 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be025069-6a89-4891-a017-fe953f387c64 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:26.154702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be025069-6a89-4891-a017-fe953f387c64 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:26.188645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:26.189255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:26.189532 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:26.189801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:26.190446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:26.191966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44526a-84a4-4e0b-b164-cb33bb49f507 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:26.336517 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 33/61] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:26 2022] POST /identity/v3/users => generated 275 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:29.799773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3f39-c3f2-4d58-bd21-7a0652130bb8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.800308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3f39-c3f2-4d58-bd21-7a0652130bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.800308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3f39-c3f2-4d58-bd21-7a0652130bb8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.801652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 29/62] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:29.807243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974801f-e672-462c-96fb-921ecafb5d3a None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.808825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974801f-e672-462c-96fb-921ecafb5d3a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.809306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974801f-e672-462c-96fb-921ecafb5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.836646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5974801f-e672-462c-96fb-921ecafb5d3a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:29.838216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5974801f-e672-462c-96fb-921ecafb5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:29.904802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:29.926464 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 34/63] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:29.983856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0eb-bef5-4d41-868a-6a56acb3b018 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.984183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0eb-bef5-4d41-868a-6a56acb3b018 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.984416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dff0eb-bef5-4d41-868a-6a56acb3b018 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.985905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 30/64] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:29.991103 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae377ef-77c3-427d-b655-676a01945b10 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.991391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae377ef-77c3-427d-b655-676a01945b10 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.991690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae377ef-77c3-427d-b655-676a01945b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.016895 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9ae377ef-77c3-427d-b655-676a01945b10 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:30.018105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9ae377ef-77c3-427d-b655-676a01945b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:30.136982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 35/65] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:30.243750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321116-a278-45e3-9720-ecc071690089 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.244063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321116-a278-45e3-9720-ecc071690089 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.244220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321116-a278-45e3-9720-ecc071690089 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.246398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 31/66] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:30.252154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808f26-e0ef-48d3-bbeb-d31e05f7661e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.252731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808f26-e0ef-48d3-bbeb-d31e05f7661e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.253210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808f26-e0ef-48d3-bbeb-d31e05f7661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.282106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-ca808f26-e0ef-48d3-bbeb-d31e05f7661e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:30.283667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-ca808f26-e0ef-48d3-bbeb-d31e05f7661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:30.298351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321116-a278-45e3-9720-ecc071690089 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:30.377830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 36/67] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:30.378944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270c284-17f5-4d6c-8d98-c276194c0180 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.379388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270c284-17f5-4d6c-8d98-c276194c0180 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.379841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270c284-17f5-4d6c-8d98-c276194c0180 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.381612 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 37/68] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:30.387828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.388207 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.388485 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.412406 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:30.413957 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:30.477676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:30.501141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321116-a278-45e3-9720-ecc071690089 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:30.516655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 38/69] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:30.543877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:30.566701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:30.567345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.567653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.567983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.588287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c2fc941d-e744-4764-93a9-b07ca44d403a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:30.593765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:30.594730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:30.595477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:30.598509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 32/70] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:30.604280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:30.682174 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8041-f046-4957-bc84-d34f08deac10 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.682528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8041-f046-4957-bc84-d34f08deac10 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.683189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d8041-f046-4957-bc84-d34f08deac10 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.684873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 33/71] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:30.691107 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.691635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.692116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.724564 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:30.725945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:30.754172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cbdd4-9965-4b0b-a8f6-760318fc6cff None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:30.792986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:30.793639 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.793922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.794204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.795952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:30.795952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:30.796576 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:30.800063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 34/72] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:30.803215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:30.812113 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 39/73] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:30.812113 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:30.867596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:30.950707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bb339-72c7-48db-bc97-2ac974a5ce02 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:30.992473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:30.993038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:30.993312 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:30.993579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:30.998229 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564e6db-6ac3-4911-bcab-c3fe6e81e7f1 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.005460 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:31.010483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:31.012342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:31.013091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 40/74] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:31.014293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.019141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.043846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.044505 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.044772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.045045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.055535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:31.061531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:31.062399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:31.063408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 35/75] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:31.064804 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.127711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.132021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9441e-da7f-496d-ba48-9d75df7bc2e9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.167797 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.168438 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.168731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.169007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.169437 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e8a8-0021-4a85-89f9-7e235230297e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.186385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.187909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.189641 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 41/76] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.190486 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.208451 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.209087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.209370 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.209642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.221256 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:31.226138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:31.226944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:31.227733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 36/77] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:31.228357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.263971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.293462 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f05752-75b3-4d2b-81e3-77707d7c2f36 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.328080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.328694 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.328975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.329339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.329993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:31.330299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.331753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.337237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c82c52-57aa-47d2-8238-6bd26752f8ba None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.339805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 42/78] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.341696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.361753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.372506 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.373110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.373388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.380412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.380412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:31.380412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.380412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.384075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 37/79] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.384877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.444594 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10139-51fb-4bee-85c5-b64f4e93b060 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.480880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.481512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.481646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.481791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.482062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.483369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.484659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.486212 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 43/80] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.486960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.489797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611192-2170-4542-a66a-d5d4d4bdd6b5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.527401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.527968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.528251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.528526 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.576632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.593084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3307b45-3cfe-4cb6-8f1c-9fb072df0531 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.600138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.601606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.628353 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a29c-9959-460e-a096-44108553c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.628977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a29c-9959-460e-a096-44108553c65a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.629257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a29c-9959-460e-a096-44108553c65a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.629529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a29c-9959-460e-a096-44108553c65a None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.630193 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a29c-9959-460e-a096-44108553c65a None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:31.630492 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a29c-9959-460e-a096-44108553c65a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.631917 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a29c-9959-460e-a096-44108553c65a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.641079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 44/81] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.641884 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a29c-9959-460e-a096-44108553c65a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.703118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.710068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 38/82] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:31.710910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.743153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a29c-9959-460e-a096-44108553c65a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.778673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.779223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.779524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.779794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.781056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.782635 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.784237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 45/83] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.784977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.804625 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.819838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2b1e5-e5b5-4c5b-84e1-ddae8e738826 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.854195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.855345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.855657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.855955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.857098 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.858532 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.860151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 39/84] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:31.860926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:31.893887 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52d00-b9e7-46a2-9fa8-ca154f7fbf90 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.924719 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:31.929098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.929704 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.929984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:31.930252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:31.930891 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:31.932371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:31.963785 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2adc7-c9d3-4aff-bcfc-2ed4b598a826 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:31.998911 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:31.999653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:31.999933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.000206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.001356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.002840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.004449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 40/85] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:31 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:32.009004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.048777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 46/86] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:31 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:32.048777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.125936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eeba6-10ea-4ffd-be53-8a7e7a522d1e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.138809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.159642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.165801 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.166485 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.166768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.167157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.168667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.170286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.172161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 41/87] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:32.172161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.181305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c204-d7bd-42c3-9bee-30d8690971f4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.221493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.222114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.222393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.222723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.308822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.310400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.316978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2bf48-58d1-4843-978a-32fa71ea517f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.369056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.369684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.370506 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.370853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.408901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.451555 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 47/88] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:32.453608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.464820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.468961 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.470642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.589322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 42/89] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:32.594220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca9fda-8dde-468f-a60c-57c8040e74ab None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.595328 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.640307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.641292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.641732 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.642198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.701129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.728270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:32.733030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d176668-5ff8-42de-ab85-73cc32392aad None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.739127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.740658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.775680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.776481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.776879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.777421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.778509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:32.779094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.780609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.787576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 43/90] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:32.788395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.919110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9ad56-954c-4f17-b59b-b90ff33bd39e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.943188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 48/91] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:32.943985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.968798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.977339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.977339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.977339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.977339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.977339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.988115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 44/92] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:32.989120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:33.063516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:33.081584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:33.091130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc369d-1032-43f2-87d7-f29ad9e8627f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:33.126952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:33.127659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:33.127953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:33.128228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:33.129367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:33.130828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:33.136345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 49/93] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:33.136345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:33.242634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207b55f-230f-4ab4-a1e0-ca658db91105 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:33.281326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:33.281956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:33.282290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:33.282511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:33.283246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] RBAC: Adding query filter params (role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:33.283695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:33.285152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:33.286933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd463d4-e5b5-4fa5-bccc-1a3b0938222d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:33.302633 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 50/94] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:33 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=a9bec09308a644beaccd586133840a4e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:33.303504 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:33.313704 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:33.332965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:33.334065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:33.334862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:33.335750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] PATH_INFO: `/v3/projects/24b997f12459478dae0ac07bf876944d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:33.337357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] RBAC: Authorizing `identity:get_project(project_id=24b997f12459478dae0ac07bf876944d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:33.339117 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:33.341262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 45/95] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/projects/24b997f12459478dae0ac07bf876944d => generated 312 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:33.349242 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:33.506618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:33.513005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914236c0-e5a6-4789-9292-56db335297bb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:33.528107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ea73-af09-4abf-8119-ba9898dacab4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:33.587619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:33.588567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:33.589058 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:33.590793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:33.591742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=24b997f12459478dae0ac07bf876944d, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:33.592308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:33.595426 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057357fa-0526-4d63-a343-09911bf14cc6 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:33.605116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:33.606120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:33.606546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 46/96] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:33 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=24b997f12459478dae0ac07bf876944d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:33.606783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:33.607216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:33.608349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=ed7003dd4df247c4b85cea0f6834c0c9) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:33.608865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:33.610646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2b43-e5ed-4ecf-ac8d-d0dce763a61e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:33.617984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 51/97] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:33 2022] GET /identity/v3/role_assignments?user.id=ed7003dd4df247c4b85cea0f6834c0c9&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:34.984991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011207fa-1cd5-4ee6-93c5-5ee7f28339d6 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:34.985485 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011207fa-1cd5-4ee6-93c5-5ee7f28339d6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:34.985485 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011207fa-1cd5-4ee6-93c5-5ee7f28339d6 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:34.986793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 47/98] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:35.001529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d59ae5-9784-49df-9c8a-43a1c3e6dc92 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.002035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d59ae5-9784-49df-9c8a-43a1c3e6dc92 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.002113 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d59ae5-9784-49df-9c8a-43a1c3e6dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.028592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-12d59ae5-9784-49df-9c8a-43a1c3e6dc92 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:35.029825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-12d59ae5-9784-49df-9c8a-43a1c3e6dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:35.113943 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:35.121910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 52/99] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:35.195476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0c791-82b4-4f69-aaee-7c9624d95d40 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.195828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0c791-82b4-4f69-aaee-7c9624d95d40 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.196061 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0c791-82b4-4f69-aaee-7c9624d95d40 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.197452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 48/100] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:35.203256 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ee5e-ad2a-4106-bf85-6e87c648e647 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.203609 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ee5e-ad2a-4106-bf85-6e87c648e647 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.203920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ee5e-ad2a-4106-bf85-6e87c648e647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.226567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9470ee5e-ad2a-4106-bf85-6e87c648e647 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:35.227782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9470ee5e-ad2a-4106-bf85-6e87c648e647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:35.305520 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 53/101] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:35.707893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0c791-82b4-4f69-aaee-7c9624d95d40 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:35.773101 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870c8d-8081-42e0-81c2-70f68a6e90e0 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.773745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870c8d-8081-42e0-81c2-70f68a6e90e0 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.774255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e870c8d-8081-42e0-81c2-70f68a6e90e0 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.775989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 54/102] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:35.782060 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.782634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.783679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.807354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:35.809566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:35.872737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0c791-82b4-4f69-aaee-7c9624d95d40 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:35.913208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:35.914223 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.914891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.916208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.919042 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:35.921792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:35.923883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 49/103] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:35.925731 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:35.936130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 55/104] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:35.937356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.001994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:36.054732 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:36.107415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cc5b4-8d76-4d56-ac23-616b7c0e9d2b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.156381 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d149245-c772-4cf1-942d-16c76ab489b4 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.172963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.173511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.173790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.174059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.174703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:36.176189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:36.232106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.232780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.233064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.233337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.250465 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:36.256153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:36.257132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:36.257916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 50/105] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:36.263000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.321793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 56/106] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:35 2022] POST /identity/v3/projects => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:36.396282 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:36.403378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331ec7-79eb-47af-9606-1117e0d197b1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.425818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.453727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.454374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.454701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.456640 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.456640 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:36.456640 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:36.457487 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:36.473137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 51/107] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:36.479437 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.660257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c06c3-6d3e-468f-a6b7-a5e015c8b70a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.687742 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:36.713166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f01174-814f-404e-ba4e-e7ea0fa7e817 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.736038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.737399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.737931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.738370 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.754805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:36.759969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:36.761424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:36.762181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:36.765042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 57/108] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:36.772585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.782593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.783331 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.783707 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.784070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] PATH_INFO: `/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.801986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] RBAC: Authorizing `identity:get_user(user_id=1bc759bf7d2445b4bc9d6ad0c8176367)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:36.803667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:36.805630 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 52/109] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367 => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:36.812056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.841612 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:36.908007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bcb8-6442-4312-b51f-095c489fe83e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:36.949018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:36.949596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.949879 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.950255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.950937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:36.951750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:36.953200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b5e9a-d8be-4ca9-8b76-e38c9f5e3838 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:36.965903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 58/110] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:36.967169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12bbe2-210b-4f28-a1e5-e8763e1bd925 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.967512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12bbe2-210b-4f28-a1e5-e8763e1bd925 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.967795 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12bbe2-210b-4f28-a1e5-e8763e1bd925 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.969507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 59/111] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:36.970535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed43e-9eb2-4f60-908f-0a9c70259901 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:36.970844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed43e-9eb2-4f60-908f-0a9c70259901 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:36.971117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed43e-9eb2-4f60-908f-0a9c70259901 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:36.976551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 60/112] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:36.977424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed43e-9eb2-4f60-908f-0a9c70259901 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:36.998464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fd04-01da-4bc6-a3df-a75d417aa87c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.027545 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.043450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.044179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.044380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.044657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.122345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed43e-9eb2-4f60-908f-0a9c70259901 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.185014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.185664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.185942 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.186217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.188336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.190141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.190270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8e36-38c9-446a-a641-2ddd55cd0fb6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.196512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 61/113] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:37.196512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1310b-d01b-4895-af8b-19c5c2b45153 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.196512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1310b-d01b-4895-af8b-19c5c2b45153 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.196512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1310b-d01b-4895-af8b-19c5c2b45153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.197479 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.215547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.219758 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-ecb1310b-d01b-4895-af8b-19c5c2b45153 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:37.221892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-ecb1310b-d01b-4895-af8b-19c5c2b45153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:37.322299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 62/114] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:37.322299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b34-f5e6-4f47-8c42-d5ef3c87ac35 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.322299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b34-f5e6-4f47-8c42-d5ef3c87ac35 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.322299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970b34-f5e6-4f47-8c42-d5ef3c87ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.350123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 53/115] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:37.350994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.353293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-38970b34-f5e6-4f47-8c42-d5ef3c87ac35 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:37.355118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-38970b34-f5e6-4f47-8c42-d5ef3c87ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:37.389965 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.441606 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 63/116] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:37.442958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e1d-0c88-4363-bfbc-1bb640c70585 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.443244 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e1d-0c88-4363-bfbc-1bb640c70585 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.443534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e1d-0c88-4363-bfbc-1bb640c70585 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.449508 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 64/117] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:37.450322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c5e1d-0c88-4363-bfbc-1bb640c70585 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.487073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072411d2-4d43-4afa-b4c4-a96dfefc6a9b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.502281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.544188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.544844 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.545133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.545415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.549755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.551208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900e2a2-4d5c-411b-ac24-3ce4174771f8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.555318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 54/118] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:37.556516 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.556805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.561030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.586154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:37.587604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:37.592681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c5e1d-0c88-4363-bfbc-1bb640c70585 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.670763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.671555 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.671839 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.672134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.673268 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.674740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.676612 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 65/119] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:37.677262 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.712432 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.721267 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 55/120] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:37.727533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.839217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540ae2c-4a81-4175-bd97-20d3e3647a8b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.881741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.882416 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.882739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.882967 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/0bab3738a4f74cc083c625922f7d4f22/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.885251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, user_id=0bab3738a4f74cc083c625922f7d4f22, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:37.888561 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:37.892225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240d20c-4ef7-4c76-9a1e-7c8dcaad7051 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:37.902927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:37.930398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:37.931042 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:37.931324 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:37.931632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:37.942215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:37.946918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:37.947817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:37.949153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 56/121] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:37.952078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:37.969340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 66/122] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:37 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/0bab3738a4f74cc083c625922f7d4f22/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:37.976602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.103219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73fa6c-f434-44f7-857a-4f7b2d8f78b2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.150752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.152524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.153228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.153705 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.154819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=1bc759bf7d2445b4bc9d6ad0c8176367) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:38.155461 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.157189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.158380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:38.164491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 57/123] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/role_assignments?user.id=1bc759bf7d2445b4bc9d6ad0c8176367&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.165759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.175544 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af16d0e-bf4f-44d5-bc01-265de073184d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.211024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:38.221682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.222428 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.224516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.224838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.240488 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:38.247202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:38.248143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:38.248981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 67/124] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:38.249609 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.313182 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c704e-0daa-4613-b4c8-9350d176a9d0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.354192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.355204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.355761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.356307 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.357225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:38.357748 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.359370 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.369348 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 58/125] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.371347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.384327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda7d4a-a2cd-407c-a53c-e79d4f7bb075 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.427788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.428125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.428333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.428604 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.442104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:38.447245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:38.449051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 68/126] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:38.449817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.476071 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:38.493804 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:38.502572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89626-41c5-4750-baeb-24ed767e9d8a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.561335 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.561966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.562249 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.562524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.563208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:38.563555 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.570115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.580758 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e2b1-264f-45c4-becc-ef47065a5c10 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.589023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 59/127] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.594248 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.655774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.656323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.656600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.656875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.658214 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.660610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.664768 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 69/128] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.666425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.803545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fbd83-ab3a-4850-b47c-c4b6db1eb806 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.812112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:38.841823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff3b5a-08ca-49cc-8fd0-04bcebf18833 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:38.856235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.856866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.857149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.871228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.871228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:38.871228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.871228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.875227 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 60/129] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.879984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:38.880420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.880665 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.881287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.881573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.882773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:38.884316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:38.886047 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 70/130] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:38.886871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:38.923319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.001842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b2ea5-cf54-4cfb-839f-261b4d469d02 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.047817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.049119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.049574 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.049747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.050988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.052480 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.056473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 71/131] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:39.058406 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.061219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb17b-ae84-49a3-8a52-6af32ac35571 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.100015 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.131962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.132754 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.132903 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.133362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] PATH_INFO: `/v3/projects/24b997f12459478dae0ac07bf876944d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.138586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] RBAC: Authorizing `identity:get_project(project_id=24b997f12459478dae0ac07bf876944d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.140137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.146133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 61/132] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:38 2022] GET /identity/v3/projects/24b997f12459478dae0ac07bf876944d => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:39.147014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.273070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ec9-8f03-4592-8d7e-1f3dd69b8c73 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.325765 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.326309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.326484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.326727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.327524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.331039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.331039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.331493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 72/133] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:39 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:39.335376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.351283 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81edb4-e767-46bb-acd8-9d0608a1d643 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.399251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.400382 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.401061 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.401723 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.403532 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.405004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.407619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 62/134] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:39 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:39.408411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.441959 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.462830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22b2c-a34a-460d-b472-d1e698235ecb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.504839 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.505611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.505959 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.506307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] PATH_INFO: `/v3/projects/24b997f12459478dae0ac07bf876944d/users/0bab3738a4f74cc083c625922f7d4f22/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.508424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] RBAC: Authorizing `identity:create_grant(project_id=24b997f12459478dae0ac07bf876944d, user_id=0bab3738a4f74cc083c625922f7d4f22, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.510590 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c467-3958-4ccc-8c42-76d4870bbb9f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.537967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c82f-dffd-4270-bdcb-74996c9907bd None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.577459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.578133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.578415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.578750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/0bab3738a4f74cc083c625922f7d4f22/roles/a9bec09308a644beaccd586133840a4e` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.580949 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, user_id=0bab3738a4f74cc083c625922f7d4f22, role_id=a9bec09308a644beaccd586133840a4e)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.582391 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4616c-c17d-48a7-b656-965c3107e706 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.642653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 73/135] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:39 2022] PUT /identity/v3/projects/24b997f12459478dae0ac07bf876944d/users/0bab3738a4f74cc083c625922f7d4f22/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:39.643969 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba44b-3322-40f2-87e8-0a6413453ea5 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.644199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba44b-3322-40f2-87e8-0a6413453ea5 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.644455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ba44b-3322-40f2-87e8-0a6413453ea5 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.645970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 74/136] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:39.646593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ba44b-3322-40f2-87e8-0a6413453ea5 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.699612 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 63/137] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:39 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/0bab3738a4f74cc083c625922f7d4f22/roles/a9bec09308a644beaccd586133840a4e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:39.701539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.701942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.702264 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.743653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:39.749510 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:39.773570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.826340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ba44b-3322-40f2-87e8-0a6413453ea5 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.869085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.869752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.870073 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.870342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/ed7003dd4df247c4b85cea0f6834c0c9/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.872647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, user_id=ed7003dd4df247c4b85cea0f6834c0c9, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.874415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.893602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 64/138] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:39.950659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:39.955374 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 75/139] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:39 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/ed7003dd4df247c4b85cea0f6834c0c9/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:40.262915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:40.381587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25529d7e-83cb-45d8-b037-ddd88acbf572 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:40.421321 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:40.421970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:40.422254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:40.422526 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:40.423740 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:40.425281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394f76-7e1e-45a3-9ef7-9922b819ec5f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:40.427086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 65/140] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:40.432361 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:40.559074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a9c87-c944-435a-b3ae-c5b7ba2eeb14 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:40.606572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:40.607197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:40.607960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:40.608298 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:40.609004 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:40.610491 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8b8b8-b361-4f51-aec1-3b5467bc0911 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:40.743279 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 76/141] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:40 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:41.447254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2792-890b-4681-9627-1ed0d987d4be None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:41.447791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2792-890b-4681-9627-1ed0d987d4be None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:41.447862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2792-890b-4681-9627-1ed0d987d4be None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:41.450165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 66/142] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:41.456200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:41.456722 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:41.456794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:41.463128 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3add50-913c-4219-a951-84ce642730a4 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:41.463572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3add50-913c-4219-a951-84ce642730a4 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:41.463888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3add50-913c-4219-a951-84ce642730a4 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:41.465396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 67/143] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:41.471199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:41.471521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:41.471822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:41.482964 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:41.484300 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:41.491832 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:41.493028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:41.504543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:41.546422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:41.567456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 77/144] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:41.605834 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 68/145] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:41.968148 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.086899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5456660-834c-4a76-882d-903f8460fb67 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.128541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.129180 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.129451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.129716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.142455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:42.147757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:42.148622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:42.149791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 78/146] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:42.155862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.264538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.294389 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b41bea-ea0a-4d4d-8d37-a14f3f41199d None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.336613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.337624 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.338096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.338557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.339650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:42.340302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:42.341024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.342085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:42.353542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 69/147] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:42.360554 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.375882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.466098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4255f5-61c5-46ca-955d-ed8ea5b0fa21 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.475721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5739da-3f9f-4949-9f3a-0a1b469c50f6 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.518894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.519548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.519838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.520571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.521768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:42.523206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:42.525161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 70/148] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:42.532466 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.577663 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.578321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.578604 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.578862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.615923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.622273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:42.627723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:42.628640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:42.629386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 79/149] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:42.637260 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.656272 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6fb3f-dc76-4855-8434-112af33a16bc None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.702181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.702803 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.703081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.703451 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.787366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:42.790299 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:42.833689 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f1e1-da8c-47e9-9eb1-0e84603990cf None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.844429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.909688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:42.912847 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.913666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.914079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.914478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.915329 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:42.915790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:42.918043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:42.935846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 80/150] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:42.947002 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 71/151] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:42.954604 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.956810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.080211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74246c-17aa-49a8-bdc0-166a22a3dcc3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.104968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59cc48-e7fb-45e2-b542-994fdebf66f9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.138315 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.139208 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.139647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.140048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] PATH_INFO: `/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.142305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] RBAC: Authorizing `identity:get_user(user_id=1bc759bf7d2445b4bc9d6ad0c8176367)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.148237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41df29-712f-4093-83bf-ad2007d8962a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.148237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 81/152] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:43.148237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6780-c5fc-4a88-a497-7b06c8827d4b None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.148237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6780-c5fc-4a88-a497-7b06c8827d4b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b6780-c5fc-4a88-a497-7b06c8827d4b None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 82/153] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b2a4-443f-487d-a628-ad838b113449 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b2a4-443f-487d-a628-ad838b113449 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b2a4-443f-487d-a628-ad838b113449 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.156737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 83/154] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:43.157415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b2a4-443f-487d-a628-ad838b113449 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.180895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.181560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.181841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.182114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.184197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.185716 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0a69-ffdb-428b-9332-639847181a8f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.187761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 72/155] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:43.188927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c00b-4594-41cd-821f-b8b74b717936 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.189247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c00b-4594-41cd-821f-b8b74b717936 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.189525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c00b-4594-41cd-821f-b8b74b717936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.228134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.229028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-6928c00b-4594-41cd-821f-b8b74b717936 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:43.231176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-6928c00b-4594-41cd-821f-b8b74b717936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:43.323889 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.349398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 73/156] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:43.350431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.350715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.351033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.368075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b2a4-443f-487d-a628-ad838b113449 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.373056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:43.373056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:43.446892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.447628 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.447910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.448218 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.450785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.454666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.460091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 84/157] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:43.460925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.469849 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 74/158] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:43.470702 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:43.686486 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d10b4d-c532-4c2d-90ac-b8bb70354303 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.687510 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.689817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:43.690626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494caaf-60e7-477f-9efd-01e6fe9d899e None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:43.746177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.746888 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.747177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.747432 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.748341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:43.748648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.750255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.761154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 85/159] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:43 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:43.785642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:43.786336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:43.786619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:43.786896 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/1bc759bf7d2445b4bc9d6ad0c8176367/roles/c1184cf6c6cc49eaa3d8b6dae2895289` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:43.793524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, user_id=1bc759bf7d2445b4bc9d6ad0c8176367, role_id=c1184cf6c6cc49eaa3d8b6dae2895289)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:43.795108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:43.881471 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 75/160] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:43 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/users/1bc759bf7d2445b4bc9d6ad0c8176367/roles/c1184cf6c6cc49eaa3d8b6dae2895289 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:44.030405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.170263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1821e6-75e7-48af-9700-9cb7ea6c410b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:44.210251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:44.210917 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.211292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.211600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.226501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:44.232219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:44.233203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:44.234376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 86/161] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:44.239673 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.352945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddafbd7-931b-449e-afb4-9c933e041005 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:44.389049 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:44.389670 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.389943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.390210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.390877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:44.391177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:44.392721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:44.402333 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 76/162] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:44.408562 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.423028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.465819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:44.467196 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:44.567452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de856d6a-7dea-4031-9b3b-3841b8c07f1f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:44.589960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef42064-2380-4948-a2e3-e1e10e33237e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:44.625348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:44.625928 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.626211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.626484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.627688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:44.629150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb6cdb-c300-474a-a902-eecae7943e02 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:44.631058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 87/163] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:44.632227 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffaa3-39c8-4b9b-af93-74cd81195fa3 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.632504 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffaa3-39c8-4b9b-af93-74cd81195fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.632778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffaa3-39c8-4b9b-af93-74cd81195fa3 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.639880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 88/164] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:44.642904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffaa3-39c8-4b9b-af93-74cd81195fa3 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.678845 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:44.679514 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.679809 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.680077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.701303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b125da42-510f-4d59-99e4-78805ea56b23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:44.706136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:44.706984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:44.708525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 77/165] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:44.710306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.717023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.717397 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.742057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:44.743399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:44.805620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:44.825310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffaa3-39c8-4b9b-af93-74cd81195fa3 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:44.850936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 78/166] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:44.851966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:44.878171 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:44.950774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:44.951403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.951708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.951978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.034527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93803-be85-451a-8ab3-419a91aac710 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:45.111811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:45.112454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.112794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.113696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.114414 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:45.115028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.116483 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:45.132225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.134028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:45.134709 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 79/167] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:45.141534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:45.399793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:45.459624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:45.466660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55b4f6-a7de-448c-8a69-acedf743926d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:45.471939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 89/168] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:45.490852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:45.547363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:45.548137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.548416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.548689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] PATH_INFO: `/v3/users/0bab3738a4f74cc083c625922f7d4f22` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.549912 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] RBAC: Authorizing `identity:get_user(user_id=0bab3738a4f74cc083c625922f7d4f22)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.551367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:45.553069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 80/169] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:45 2022] GET /identity/v3/users/0bab3738a4f74cc083c625922f7d4f22 => generated 275 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:45.563528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:45.691874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0a61e-11fa-4f72-b3da-03d7a47b20e8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:45.743297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:45.744409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.744902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.746265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.750925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.753062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:45.756326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 90/170] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:45 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:45.763746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:45.781887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa7c4-d340-4cc8-9ba2-f4a8d2f250c1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:45.845507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:45.847392 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.848344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.850765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.894326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:45.937675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:45.991642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.993287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37edf10-372d-451a-a5cb-25df5fd90560 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.007170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927f9a5-1ce0-45ea-acad-4ced9873d9b4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.064144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.064795 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.065069 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.065336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.078490 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:46.084337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:46.090950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 91/171] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:46.091861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.142697 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 81/172] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:46.144079 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b35fe-09e7-4439-b648-740b243ef3ee None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.144433 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b35fe-09e7-4439-b648-740b243ef3ee None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.144775 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b35fe-09e7-4439-b648-740b243ef3ee None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.146354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 82/173] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.153480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb777bc-efd3-49bc-b9c7-2b77fd92fbfc None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.154087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb777bc-efd3-49bc-b9c7-2b77fd92fbfc None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.154489 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb777bc-efd3-49bc-b9c7-2b77fd92fbfc None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.155997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 83/174] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.156776 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb777bc-efd3-49bc-b9c7-2b77fd92fbfc None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.213589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.219630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ffffd-96e3-42a1-9514-96dbd6efc7e0 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.246081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.258323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.259022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.259304 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.259624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.260512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] RBAC: Adding query filter params (role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:46.261365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.263109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.269804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 92/175] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=a9bec09308a644beaccd586133840a4e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:46.277162 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.295191 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb777bc-efd3-49bc-b9c7-2b77fd92fbfc None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.374662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.375627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.376230 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.376686 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.379197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:46.380008 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.383602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e125-d4f2-4c05-914e-e9d373d8054d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.402185 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 84/176] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:46.405164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.407264 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.407717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.452162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.454137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.495776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099179-0b6f-477e-a945-3fbffa6f27ad None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.545707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.546350 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.546624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.546888 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] PATH_INFO: `/v3/projects/24b997f12459478dae0ac07bf876944d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.548138 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] RBAC: Authorizing `identity:get_project(project_id=24b997f12459478dae0ac07bf876944d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.549715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05082ba-5001-4d19-bd3e-278236c42a43 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.551880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 93/177] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/projects/24b997f12459478dae0ac07bf876944d => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:46.553205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.553483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.553808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.575776 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 85/178] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:46.576522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.577089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.578479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.652440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.715418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:46.734517 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 94/179] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:46.735933 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:46.763646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d078c6-dcf4-4b83-bc16-8502732f0da0 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.799032 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.799820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.800355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.800482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] PATH_INFO: `/v3/users/ed7003dd4df247c4b85cea0f6834c0c9` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.802687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] RBAC: Authorizing `identity:get_user(user_id=ed7003dd4df247c4b85cea0f6834c0c9)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.806436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f274b-2a78-4233-bd4b-9070005c8f6e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:46.806436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 86/180] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/users/ed7003dd4df247c4b85cea0f6834c0c9 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:46.808507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c321f-236d-44ad-90f6-b1082239425a None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.808939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c321f-236d-44ad-90f6-b1082239425a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.809207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c321f-236d-44ad-90f6-b1082239425a None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.810574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 87/181] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:46.825016 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.831570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.831570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.861280 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:46.862868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:46.953641 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b4f1c-793a-4df4-aa06-4ed4f4b94d24 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:46.992600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:46.993486 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:46.993899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:46.994298 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:46.995210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=24b997f12459478dae0ac07bf876944d, user.id=0bab3738a4f74cc083c625922f7d4f22) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:46.995817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:46.997475 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.001953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 88/182] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:47.002901 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.004803 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 95/183] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:46 2022] GET /identity/v3/role_assignments?user.id=0bab3738a4f74cc083c625922f7d4f22&scope.project.id=24b997f12459478dae0ac07bf876944d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.055082 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.060744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.156188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.156387 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab593a-f2ab-437f-86bd-13c479773cb4 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.195571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.196244 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.196523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.196797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.246761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd88ee-ec4d-4615-ba86-ce986ecc93fc None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.273760 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.275256 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.304867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887305-ff45-461e-abd3-99912b256341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.306066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887305-ff45-461e-abd3-99912b256341 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.306563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887305-ff45-461e-abd3-99912b256341 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.307043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887305-ff45-461e-abd3-99912b256341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.310234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.323619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82887305-ff45-461e-abd3-99912b256341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-82887305-ff45-461e-abd3-99912b256341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:47.331237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:47.334918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 96/184] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:47.335764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887305-ff45-461e-abd3-99912b256341 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.407112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 89/185] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:47.412453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.469539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887305-ff45-461e-abd3-99912b256341 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.484321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.521578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.522281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.522559 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.522875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.536804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:47.544423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:47.545360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:47.546142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 97/186] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:47.546859 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.558566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19e95-2f8c-42bd-8053-a8dbba4824b5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.591917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.597813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.598428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.606500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.606500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.606500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:47.606500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.606500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.614429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 90/187] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.615302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.665070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490aeed-bced-4a3d-ae00-1f27e12d42d9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.701398 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.702034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.702315 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.702583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.703752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.705212 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06a31-2e69-4406-a6ec-a3d37d3475bf None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.706864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 98/188] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.708024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9edf0c-b718-49a4-a6fe-a027ba1d2185 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.708322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9edf0c-b718-49a4-a6fe-a027ba1d2185 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.708572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9edf0c-b718-49a4-a6fe-a027ba1d2185 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.711623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 99/189] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:47.711623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9edf0c-b718-49a4-a6fe-a027ba1d2185 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.725848 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a4e3e-2434-480e-8a81-253043ec1b08 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.756948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.765492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.766118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 91/190] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.773447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.825664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9edf0c-b718-49a4-a6fe-a027ba1d2185 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.842288 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.861178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.861791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.862066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.862342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.863016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:47.863309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.864723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.878736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 100/191] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.878736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.881771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131b8d2-126d-467b-aff0-324dd0120d5b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.916107 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.916733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.917053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.917318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.931020 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.932504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997456-9982-4e82-9add-7e41ab795ced None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.934744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 92/192] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:47.935986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.936259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.936535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.958613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:47.966971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:47.990125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:47.995228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690fe7-e283-4956-bced-3c8671817527 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.032793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.033392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.033662 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.033956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.034682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=ed7003dd4df247c4b85cea0f6834c0c9) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:48.034982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.036438 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.042923 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 101/193] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/role_assignments?user.id=ed7003dd4df247c4b85cea0f6834c0c9&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:48.043705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.060418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 93/194] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:48.060418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.120990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.181719 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940c05-7fce-49ac-ba86-5af8ee8d84cd None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.184714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25e98a-2286-46d6-8989-85385a350961 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.226387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.226712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.227034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.227326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.228015 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.230198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.234035 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.235124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.235584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.236000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.237509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.239265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.241468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 94/195] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:48.247785 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.360383 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 102/196] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:48 2022] POST /identity/v3/users => generated 297 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:48.361231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.378917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330509e5-c1d6-42b3-acad-39d86e8774ae None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.393897 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.403459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.422374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.423016 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.423296 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.423613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.486538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d17-af5f-488b-9640-32d1c4d11bda None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.511395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.513071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.529592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.530402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.530512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.530744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.616332 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.617873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.636488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 95/197] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:48.637538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.642296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.669863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.757052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 103/198] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:48.758271 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.775807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3545843-0741-458d-b8dd-77cdddd4adeb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.827024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.828211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.828487 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.828753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.845230 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:48.851394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:48.852306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:48.853075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:48.856425 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 96/199] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:48.861111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.890174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793781-d34c-46b6-9fd6-eadc2db88280 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:48.911726 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.928069 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:48.928671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:48.928943 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:48.929211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:48.930393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:48.931930 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:48.934305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 104/200] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:48.935268 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:48.975068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:48.998701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dea7d-ec27-475f-a3c6-3cfc5b88ae3d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.037533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.038416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.038955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.039231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.040556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.042888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.045020 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 97/201] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:49.045165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:49.053244 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a691e-1087-4ed5-8239-2153b81a3cde None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.101278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.101901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.102179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.102446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.103108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:49.103406 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.105507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.118717 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 105/202] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:49.120066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:49.187411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b148725-09a0-4640-8952-01b63d5c716b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.190021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:49.235665 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.236278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.236556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.236827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.237558 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=864c26a85a1e4f3ebaf666bb6767cb85) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:49.237862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.239307 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.251938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 98/203] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:49 2022] GET /identity/v3/role_assignments?user.id=864c26a85a1e4f3ebaf666bb6767cb85&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:49.253070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:49.256609 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6bb0-c1b6-48a2-9177-01f1a0edc26b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.281764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:49.301568 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.302515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.302936 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.303345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.304305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] RBAC: Adding query filter params (role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=864c26a85a1e4f3ebaf666bb6767cb85) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:49.304798 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.307295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.313936 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 106/204] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:49 2022] GET /identity/v3/role_assignments?user.id=864c26a85a1e4f3ebaf666bb6767cb85&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=a9bec09308a644beaccd586133840a4e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:49.433549 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3951-b281-48db-ad4e-4e049279b9a0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.483250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.484171 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.484612 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.485098 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] PATH_INFO: `/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.486619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] RBAC: Authorizing `identity:get_user(user_id=1bc759bf7d2445b4bc9d6ad0c8176367)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.488326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.490257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 99/205] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:49 2022] GET /identity/v3/users/1bc759bf7d2445b4bc9d6ad0c8176367 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:49.498692 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:49.656846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf6bc-dd88-4fcd-a0eb-78bb74a3c221 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:49.673254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:49.695599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:49.712257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:49.712257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:49.712257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:49.799563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:49.800974 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:49.920087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 107/206] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:49.925812 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.060179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:50.085286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850bfaf-1a01-4579-ab4b-cee4fa890b44 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:50.133422 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:50.134075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.134358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.134633 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.136504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:50.138016 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafdf6b-f9cc-446f-8108-1381ccd682df None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:50.139858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 100/207] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:49 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:50.145948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.176677 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:50.301269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad273a2-9a5b-4905-b84d-bee98f53c675 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:50.350265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:50.350798 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.351072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.351337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.352090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, scope.project.id=c68afc4e23fd4e879b16363134aaaca5, user.id=1bc759bf7d2445b4bc9d6ad0c8176367) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:50.352394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:50.353863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd6072-b48f-4898-811f-19f1e9f4c169 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:50.361995 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 108/208] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:50 2022] GET /identity/v3/role_assignments?user.id=1bc759bf7d2445b4bc9d6ad0c8176367&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:51.067705 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df99-5ecc-43c6-ad92-717025dd22f6 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.068213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df99-5ecc-43c6-ad92-717025dd22f6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.068311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0df99-5ecc-43c6-ad92-717025dd22f6 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.069600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 101/209] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:51.075778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.076117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.076392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.100083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:51.101377 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:51.145102 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72f76-c924-4d51-b687-af8d359b218d None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.145627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72f76-c924-4d51-b687-af8d359b218d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.145906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af72f76-c924-4d51-b687-af8d359b218d None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.147270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 102/210] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:51.153250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.153517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.153795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.175371 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:51.177337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:51.190688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 109/211] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:51.257004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 103/212] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:51.541171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.552911 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.636654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.680168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e601-4f1e-4df8-970a-092a845737fb None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.734099 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.734756 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.735036 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.735305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.756796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.759880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:51.767201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:51.769006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:51.769806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 110/213] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:51.777057 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.803048 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa1501-1460-46bc-8a35-2ef41f7970f1 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.861443 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:51.870701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.871962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.880262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.880262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.880262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.880262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.880262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 104/214] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:51.884215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:51.908548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c34ac7-c801-49b8-a3ee-13bc7c263dc7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:51.955455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:51.956292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:51.956674 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:51.957046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:51.957937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:51.958340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:51.959992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:51.970721 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 111/215] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:51.981207 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.024663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae3066-cb0d-4efc-9f47-3d7226074755 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.063987 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:52.064633 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.064915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.065191 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.065883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:52.067409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e96fac-7ae0-41dc-a0ff-53bdf96dd94f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:52.109358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc819268-9115-4216-8bba-bd429b33f832 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.140038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:52.146754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:52.147395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.147730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.148171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] PATH_INFO: `/v3/users/c1e9f4a6167f498397405f4a556cf60f` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.166507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e9f4a6167f498397405f4a556cf60f)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:52.168505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464da21e-9fee-4986-9425-d26cc7c70a40 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:52.170328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 112/216] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:51 2022] GET /identity/v3/users/c1e9f4a6167f498397405f4a556cf60f => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:52.171534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b55b-3ac6-4fa2-a81a-12d91ee5e00e None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.171813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b55b-3ac6-4fa2-a81a-12d91ee5e00e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.172086 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b55b-3ac6-4fa2-a81a-12d91ee5e00e None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.177672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 113/217] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:52.177672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b55b-3ac6-4fa2-a81a-12d91ee5e00e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.259794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:52.264946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 105/218] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:51 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:52.266286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b66e-5c47-4343-af81-8328d0fc87f2 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.266565 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b66e-5c47-4343-af81-8328d0fc87f2 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.266833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4b66e-5c47-4343-af81-8328d0fc87f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.287569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-56d4b66e-5c47-4343-af81-8328d0fc87f2 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:52.289173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-56d4b66e-5c47-4343-af81-8328d0fc87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:52.321064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b55b-3ac6-4fa2-a81a-12d91ee5e00e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.367635 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:52.368284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.368580 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.368830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.387364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 106/219] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:52.388856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec45f-d5eb-48d6-be94-684f935a6ae8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.389738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec45f-d5eb-48d6-be94-684f935a6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.389738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eec45f-d5eb-48d6-be94-684f935a6ae8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.391165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 107/220] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:52.401293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.401768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.402971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.428576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:52.430542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:52.455793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:52.478146 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:52.479810 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:52.532560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 108/221] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:11:52.613611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 114/222] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:52.620962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.692611 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:52.742649 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484b5de-7c19-403b-a0ec-9ddc7bf28453 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.755517 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.796062 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:52.796717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.797034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.797364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.799104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:52.800613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:52.803065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 109/223] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:52 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:52.809326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.871729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:52.886801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7b20-2f06-41dc-b4e8-40c9536cc2a7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.934892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:52.935556 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.936010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.936286 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.951274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:52.957658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:52.958565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:52.959348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 115/224] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:52.960130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:52.964504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc86c89-96e6-4269-a044-b424aae3ad11 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:52.999353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.008468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.009084 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.009360 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.014778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.014778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=c1e9f4a6167f498397405f4a556cf60f) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:53.014778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.014778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.020763 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 110/225] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:52 2022] GET /identity/v3/role_assignments?user.id=c1e9f4a6167f498397405f4a556cf60f&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:53.021550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.093673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ac1e-b507-44e5-b95f-ec6a0de2f425 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.133570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.134141 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.134420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.134712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.147668 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:53.153575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:53.154620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:53.160877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 116/226] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:53.163331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.177439 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11616-8378-4471-84c6-bec4cbdf151a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.190226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.235089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.236117 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.236621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.237089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.237967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:53.238471 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.241418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.252700 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 111/227] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:53.259525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.299873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787da0e0-5a66-421e-98ce-09f6c30c9e32 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.343453 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.344132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.344405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.344910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.345846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:53.346040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.347401 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.357047 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 117/228] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:53.368729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.369632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.431546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcfe3-d580-4cc9-99d1-412ac32141a9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.459819 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.493678 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8207c-4fc2-4d72-aad6-dfb51ec24b16 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.535136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.535899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.536198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.536316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.536512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.536854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.537137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.537413 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.537599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.538609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.539177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.540114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.541728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 118/229] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:53.543547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 112/230] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:53.548536 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.550865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.675915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2189f4-ff89-4f92-95df-3e99ea5bbdc5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.699921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.700779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ec301-12dd-4683-93b8-fbad8266050c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.712895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.713888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.714994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.715431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.716853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.718888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.721151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 113/231] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:53.728403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.755010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.756163 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.757530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.758760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.760263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.763213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.765296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 119/232] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:53.772354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.790846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:53.915362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db4eb-9a56-44a9-adcb-a0ace2021602 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.976679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59b30-d4e2-4e7c-b149-e58e435245a9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.989372 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.990049 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.990328 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.990601 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/864c26a85a1e4f3ebaf666bb6767cb85/roles/a9bec09308a644beaccd586133840a4e` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.995620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, user_id=864c26a85a1e4f3ebaf666bb6767cb85, role_id=a9bec09308a644beaccd586133840a4e)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.997201 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085201b2-2b9b-4f02-a1ec-2cd174360f42 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:54.024261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:54.024922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:54.025201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:54.025530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/864c26a85a1e4f3ebaf666bb6767cb85/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:54.028153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, user_id=864c26a85a1e4f3ebaf666bb6767cb85, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:54.029778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703908f-1818-4af0-918a-8b9cee0821ed None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:54.095957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 114/233] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:53 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/864c26a85a1e4f3ebaf666bb6767cb85/roles/a9bec09308a644beaccd586133840a4e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:54.134028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 120/234] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:53 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/864c26a85a1e4f3ebaf666bb6767cb85/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:55.198218 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1afdb-1142-4314-a192-432679932958 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.199338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1afdb-1142-4314-a192-432679932958 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.199645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1afdb-1142-4314-a192-432679932958 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.201081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 115/235] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:55.211358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd246-6c1b-48e3-9907-9b063787ecdc None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.212001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd246-6c1b-48e3-9907-9b063787ecdc None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.212001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd246-6c1b-48e3-9907-9b063787ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.236475 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9babd246-6c1b-48e3-9907-9b063787ecdc None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:55.237684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9babd246-6c1b-48e3-9907-9b063787ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:55.321873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:55.333741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 121/236] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:55.402371 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093c9c-002e-4f64-b77d-5cefcb4c5464 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.402741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093c9c-002e-4f64-b77d-5cefcb4c5464 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.402916 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15093c9c-002e-4f64-b77d-5cefcb4c5464 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.404288 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 116/237] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:55.412138 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0c1e-7f20-41f8-ab26-fa1350a1aba8 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.412625 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0c1e-7f20-41f8-ab26-fa1350a1aba8 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.413101 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d0c1e-7f20-41f8-ab26-fa1350a1aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.432603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a94d0c1e-7f20-41f8-ab26-fa1350a1aba8 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:55.434320 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a94d0c1e-7f20-41f8-ab26-fa1350a1aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:55.505544 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 122/238] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:55.733855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577cacd-0371-4597-b1e7-30cb3747d9e3 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.734180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577cacd-0371-4597-b1e7-30cb3747d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.734397 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577cacd-0371-4597-b1e7-30cb3747d9e3 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.736045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 117/239] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:55.741010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.741295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.741565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.768572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:55.769679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:55.800792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577cacd-0371-4597-b1e7-30cb3747d9e3 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:55.849404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 123/240] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:55.878193 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:55.906672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:55.953124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577cacd-0371-4597-b1e7-30cb3747d9e3 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:55.977570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.030374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.031419 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.032009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.032560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.038224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4137e-98fb-4eff-824c-70f462c35147 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.039062 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.040995 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.043756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 118/241] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:11:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:56.048936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.077243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.078037 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.078749 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.078749 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.094308 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:56.096427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:56.097343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:56.098150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 124/242] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:56.107745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.226825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968520-e3a5-47a1-8f6c-a42e0cb44881 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.241017 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242984c-00d4-4fb8-8cd4-0bf6f27ccef3 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.251867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.262342 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.276912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.277700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.278070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.278344 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.279008 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:56.279303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.280864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.281854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.282584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.282958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.283329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.284096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.285927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.290525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 125/243] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:56.291585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.373925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 119/244] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:56 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:56.375126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.445747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82f7d-b17a-4a31-a21b-b467566f14b5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.520692 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb44e6-6bea-4ef7-9043-9f601667e946 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.565226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.565787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.565994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.566145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.566390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] PATH_INFO: `/v3/users/627c12a8be94481e8c1397b69fd7f0ae` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.566542 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.566705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.566956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.584302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] RBAC: Authorizing `identity:get_user(user_id=627c12a8be94481e8c1397b69fd7f0ae)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.585876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:56.586099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.588878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 120/245] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/users/627c12a8be94481e8c1397b69fd7f0ae => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:56.591524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:56.592418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:11:56.593472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:11:56.594065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 126/246] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:56.596006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.600813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.646082 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.656343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.738349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2cf26-40d1-4c1e-a1c8-29bca9d9c8f2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.745331 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342154e-b75d-417e-96b5-272be25a2df7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.787400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.788120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.788459 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.788789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.788984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.789573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:56.789935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.790166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.790625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.791076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.791572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.803268 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 127/247] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:56.811627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.890593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.892476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be4ae-0d90-4df0-a819-89f801ba0167 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.941129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.960000 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:56.964535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42970320-76bf-4022-b78d-da57a351e256 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:57.012716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:57.013478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.013757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.014026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] PATH_INFO: `/v3/users/c1e9f4a6167f498397405f4a556cf60f` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.015478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e9f4a6167f498397405f4a556cf60f)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:57.016961 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:57.019428 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 128/248] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/users/c1e9f4a6167f498397405f4a556cf60f => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:57.025833 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:57.039847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 121/249] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:57.041091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d03781-b326-455b-ae5b-20464c7fa6c8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.041382 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d03781-b326-455b-ae5b-20464c7fa6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.041657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d03781-b326-455b-ae5b-20464c7fa6c8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.047899 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 122/250] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:57.049560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d03781-b326-455b-ae5b-20464c7fa6c8 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:57.156366 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca04a4-23a0-4c07-925e-4a29c5fa36f6 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:57.178008 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d03781-b326-455b-ae5b-20464c7fa6c8 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:57.204229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:57.205529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.206105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.206984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.210091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:57.212590 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1b57-81f6-4760-8894-a1538a92324b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:57.214806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:57.216576 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 129/251] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:57 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:57.217708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.217989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.218523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.224054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:57.225586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.226450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.227135 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.228629 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:57.230343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886fe2a-dc10-42cb-892c-3240bf64d93e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 123/252] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:57 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94db2-285b-4718-9616-ae8e56ce0323 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94db2-285b-4718-9616-ae8e56ce0323 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb94db2-285b-4718-9616-ae8e56ce0323 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 124/253] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:57.237953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94db2-285b-4718-9616-ae8e56ce0323 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:57.242575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:57.243805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:57.274800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:57.328123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 130/254] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:57.329284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:57.373702 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb94db2-285b-4718-9616-ae8e56ce0323 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:57.413938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:57.414651 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.415002 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.415813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/c1e9f4a6167f498397405f4a556cf60f/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.418784 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, user_id=c1e9f4a6167f498397405f4a556cf60f, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:57.420683 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:57.475524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1bba-4fdd-4010-ba15-5d89f008220e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:57.515857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:57.516526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.516802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.517119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.517852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=627c12a8be94481e8c1397b69fd7f0ae) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:57.518197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:57.519977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325aeb3-27e0-4287-82bc-e50b0562d6d7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:57.527512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 131/255] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:57 2022] GET /identity/v3/role_assignments?user.id=627c12a8be94481e8c1397b69fd7f0ae&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:57.528949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:57.529233 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:57.529551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:57.530075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 125/256] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:57 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/c1e9f4a6167f498397405f4a556cf60f/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:57.561632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:57.562970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:57.595052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:57.645169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 132/257] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:11:57.853130 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:57.934316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:57.979126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de40a86-8454-41ef-95c5-17067aa53b99 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.022568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.023589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.024081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.024535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.037709 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:58.043777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:58.044643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:58.045446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:58.047724 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 126/258] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:58.053855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.167844 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.206398 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430ba0-b850-40b3-bf17-4932d1762002 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.269978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.270634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.270873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.271136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.271831 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:58.272131 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.273933 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.287042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 133/259] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:58.293225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.348190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.394606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41fbd-d15f-4738-aed3-fc53eebb5253 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.432006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.463714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.465329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.465655 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.465927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.484413 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:58.484737 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ac8e2-1e31-42cc-a8fc-a58ec9aeb8a7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:58.490495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:58.491369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:11:58.492519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:11:58.495022 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 127/260] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:58.502123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.551215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.551866 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.552203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.552474 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.554241 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.555707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.559019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 134/261] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:58.563238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.675598 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412e4d-37db-4c4e-9db4-841545ff58bf None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.715840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.717133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.717553 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.717955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.719022 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:58.719541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.721110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.736173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 128/262] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:58.742260 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:58.748102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.763555 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42598daf-e580-44a3-af65-4ac71397d2ee None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:58.802910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:58.803552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:58.803830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:58.804096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:58.830393 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:58.920610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:58.922087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:58.951316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3968-223b-4186-9232-294746a944f0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.023313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.023902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.024178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.024447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] PATH_INFO: `/v3/users/864c26a85a1e4f3ebaf666bb6767cb85` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.025675 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] RBAC: Authorizing `identity:get_user(user_id=864c26a85a1e4f3ebaf666bb6767cb85)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.028797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.030402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 129/263] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/users/864c26a85a1e4f3ebaf666bb6767cb85 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:59.035945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.071879 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.089889 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 135/264] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:59.095711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.178021 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c45e4-3dbb-4b9f-a157-becf63cbee27 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.190621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.223926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.224562 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.224840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.225108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.302090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad4195-c8f3-490b-b571-e843c504f785 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.358083 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.359663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.374220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.374925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.375206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.375522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.376963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.378441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.380131 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 136/265] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:59.388478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.531853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.586071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 130/266] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:11:59.595454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.611276 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:59.653808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3147-92ae-4306-8daa-9d3034587e5e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.718026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.718791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.719063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.719326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.720072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=864c26a85a1e4f3ebaf666bb6767cb85) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:59.720368 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.721809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.728029 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 137/267] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/role_assignments?user.id=864c26a85a1e4f3ebaf666bb6767cb85&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:59.769400 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03a0b6-c6bf-4d7b-a79a-bcaaa8e32e46 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:59.825235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:59.826215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.826633 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.827042 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.832478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:59.834257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3c6a-d015-45eb-9ca0-41882a23324d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:59.836652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 131/268] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:59.842585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:59.980235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7cfb-2a7d-4211-b529-d0bf6c254bb5 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.980919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7cfb-2a7d-4211-b529-d0bf6c254bb5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.981534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7cfb-2a7d-4211-b529-d0bf6c254bb5 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:59.984172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 132/269] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:59.993018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8405-4938-4cdd-9d77-1f37d1b7e2b8 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:59.993634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8405-4938-4cdd-9d77-1f37d1b7e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:59.994097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8405-4938-4cdd-9d77-1f37d1b7e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.025061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b39aa0-2c60-40ef-97bf-7b119312cf14 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.032674 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-219d8405-4938-4cdd-9d77-1f37d1b7e2b8 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:00.034238 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-219d8405-4938-4cdd-9d77-1f37d1b7e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:00.074805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.098107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.098784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.099064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.099333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.100089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] RBAC: Adding query filter params (role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=864c26a85a1e4f3ebaf666bb6767cb85) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:00.100394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.102111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da409b8-e300-4138-8e02-ce126a51ce63 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.109729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 138/270] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:59 2022] GET /identity/v3/role_assignments?user.id=864c26a85a1e4f3ebaf666bb6767cb85&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=a9bec09308a644beaccd586133840a4e => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.182021 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 133/271] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:00.288886 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8b81-e108-4c31-929f-624c60951558 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.289204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8b81-e108-4c31-929f-624c60951558 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.289433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f8b81-e108-4c31-929f-624c60951558 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.291027 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 139/272] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:00.298298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.298907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.299372 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.324937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:00.326503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:00.331035 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.411538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 134/273] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:00.568714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f8b81-e108-4c31-929f-624c60951558 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.714905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f8b81-e108-4c31-929f-624c60951558 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.751343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.752084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.752357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.752623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.763075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:00.767813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:00.768670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:00.769826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 140/274] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:00.780635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.840311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.887686 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42937b71-1ff0-447a-b8fc-fe3e17ddb4ce None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.898642 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.921580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.922108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.922387 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.922652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.923319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:00.923661 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.925033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e91f6-ea50-4aeb-9b67-88f79d72066c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.930275 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.934408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 135/275] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:00.935795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580047-680a-453f-9686-a657c4f9e4f0 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.936083 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580047-680a-453f-9686-a657c4f9e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.936348 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580047-680a-453f-9686-a657c4f9e4f0 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.937671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 136/276] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:00.938857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4905-ef53-46b5-89e1-fad8a1c4cd21 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.938857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4905-ef53-46b5-89e1-fad8a1c4cd21 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.939331 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf4905-ef53-46b5-89e1-fad8a1c4cd21 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.940714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 137/277] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:00.941336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf4905-ef53-46b5-89e1-fad8a1c4cd21 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.967276 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d396b9-4224-4861-b5f9-9564a48d8bcb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.003616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.004250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.004537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.004805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.005939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.007385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16519257-29e8-4abd-8b98-2783dd531f7c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.008975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 141/278] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:01.010215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbae7-e2d3-425a-a19f-f24bd9d13076 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.010500 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbae7-e2d3-425a-a19f-f24bd9d13076 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.010772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbae7-e2d3-425a-a19f-f24bd9d13076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.028788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-4ebdbae7-e2d3-425a-a19f-f24bd9d13076 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:01.029991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-4ebdbae7-e2d3-425a-a19f-f24bd9d13076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:01.051929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf4905-ef53-46b5-89e1-fad8a1c4cd21 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.088063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.088690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.088971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.090069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] PATH_INFO: `/v3/users/766eca6c90b14991bbab7620b31b39e0` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.101424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 142/279] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:01.102659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.102937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.103207 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.118260 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] RBAC: Authorizing `identity:get_user(user_id=766eca6c90b14991bbab7620b31b39e0)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.119860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.121137 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:01.122495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:01.122614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 138/280] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/users/766eca6c90b14991bbab7620b31b39e0 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.123635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.169349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.187593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.197769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 143/281] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:01.198570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.253149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d795e-e17a-4fa9-a7db-b3766959fc25 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.290205 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.291165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.291660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.292421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.293343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.294990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.328860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09ce7-c037-468d-ad6a-4b28a4cc0034 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.365191 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.365869 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.366147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.366415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.367140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, user.id=766eca6c90b14991bbab7620b31b39e0, scope.system=all) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:01.367439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.368945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.375024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 144/282] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/role_assignments?user.id=766eca6c90b14991bbab7620b31b39e0&scope.system=all&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.414027 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 139/283] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:01 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:01.437252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.489753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.530308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.567031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de833-fa41-4502-9aa4-87dc0a17805a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.611644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.612428 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.612828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.613107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.627744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:01.633183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:01.634112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:01.634901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 145/284] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:01.641546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.682284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b7b4-3f44-4beb-b225-ee3601406226 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.701316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.727259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.727947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.728365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.728636 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.748441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:01.750777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:01.751989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:01.752810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 140/285] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:01.758304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.787800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:01.793797 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62e224-b0f7-48e5-aed3-757aa8f9aab2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.841921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.842543 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.842823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.843127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.844261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:01.844562 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.846679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.859175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 146/286] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.865455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:01.896347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7360ee4-9dc8-4bdc-a50c-4e70b52f02b3 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:01.946520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:01.947157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:01.947439 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:01.947746 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:01.948490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:01.949384 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:01.951163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:01.965246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 141/287] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:01.971476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.017952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.036873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eec7c7-1a4f-460b-8178-3aeacbac8909 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.095250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.096928 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.097989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.098270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] PATH_INFO: `/v3/users/c1e9f4a6167f498397405f4a556cf60f` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.101681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] RBAC: Authorizing `identity:get_user(user_id=c1e9f4a6167f498397405f4a556cf60f)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.103811 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.106089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f4ad-ec7e-4899-9973-93b78d90646f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.110455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 147/288] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/users/c1e9f4a6167f498397405f4a556cf60f => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:02.121484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.170640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.175390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.176060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.176337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.176610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] PATH_INFO: `/v3/users/627c12a8be94481e8c1397b69fd7f0ae` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.178557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=627c12a8be94481e8c1397b69fd7f0ae)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.180974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.190755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 142/289] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:01 2022] GET /identity/v3/users/627c12a8be94481e8c1397b69fd7f0ae => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.193616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.311830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626fa2a-e49d-4bf7-904a-a251e9133e7b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.371341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706c8d6-e8d1-4fa1-a0e1-2143d315f5b2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.383840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.397176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.401114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.401114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.401114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.418748 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.419814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.420310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.420768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.423424 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.425159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.427007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 143/290] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.434545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.538109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.539963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.611835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9235-1f56-4937-8bc9-126a8ca4587f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.623143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.655864 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.656955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.662553 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.664692 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/627c12a8be94481e8c1397b69fd7f0ae/roles/c1184cf6c6cc49eaa3d8b6dae2895289` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.670135 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, user_id=627c12a8be94481e8c1397b69fd7f0ae, role_id=c1184cf6c6cc49eaa3d8b6dae2895289)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.674273 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.733986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 148/291] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:02.740532 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.778331 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 144/292] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:02 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/users/627c12a8be94481e8c1397b69fd7f0ae/roles/c1184cf6c6cc49eaa3d8b6dae2895289 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:12:02.850992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea465dd-bee9-49da-ba23-a3906f6910c5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:02.890918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:02.899596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:02.900328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:02.900610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:02.901976 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:02.902525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:02.904226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee7b6-a5e4-4a14-8108-a93077a152d3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:02.906380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 149/293] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:02.912658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:02.951641 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:03.039752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a3bd-af4c-4e85-9e54-fb0ebf636b62 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:03.079080 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:03.079793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.080073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.080342 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.081092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=c1e9f4a6167f498397405f4a556cf60f) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:03.081396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:03.082840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272449b-0864-4c4c-8e58-f1f20ab5d7d4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:03.089869 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 145/294] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:02 2022] GET /identity/v3/role_assignments?user.id=c1e9f4a6167f498397405f4a556cf60f&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:03.910471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfada03-5ffc-44f5-87b6-5c9522a6a844 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.911035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfada03-5ffc-44f5-87b6-5c9522a6a844 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.911035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfada03-5ffc-44f5-87b6-5c9522a6a844 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.912869 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 150/295] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:03.919220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce85c-ff22-4e95-8c73-d6780053a50f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.919737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce85c-ff22-4e95-8c73-d6780053a50f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.919819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce85c-ff22-4e95-8c73-d6780053a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.939282 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-7ffce85c-ff22-4e95-8c73-d6780053a50f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:03.940735 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-7ffce85c-ff22-4e95-8c73-d6780053a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:04.016468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 146/296] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:04.266169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167be8-774f-4f07-873e-4659b6c13523 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.266355 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167be8-774f-4f07-873e-4659b6c13523 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.266640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25167be8-774f-4f07-873e-4659b6c13523 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.268336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 151/297] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:04.277909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e1f3-7752-439f-9602-e679b95089f1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.277909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e1f3-7752-439f-9602-e679b95089f1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.277909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e1f3-7752-439f-9602-e679b95089f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.294913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-3b35e1f3-7752-439f-9602-e679b95089f1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:04.296138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-3b35e1f3-7752-439f-9602-e679b95089f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:04.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.368194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167be8-774f-4f07-873e-4659b6c13523 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.375052 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 147/298] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:04.393669 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b952d-5364-45f9-8980-254d494a2c66 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.394029 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b952d-5364-45f9-8980-254d494a2c66 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.394224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b952d-5364-45f9-8980-254d494a2c66 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.395902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 148/299] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:04.401378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.402315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.402661 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.422326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:04.423542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:04.501618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25167be8-774f-4f07-873e-4659b6c13523 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.501962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 149/300] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:04.538970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.539563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.539844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.540116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.551954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:04.556914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:04.558470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:04.559718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 152/301] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:04.565254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.664294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.677383 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f731fd-02d6-4d29-a4dc-2cdd579b0634 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.715018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.715718 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.715996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.716265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.716935 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:04.717233 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.718953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.728806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 150/302] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:04.735623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.764661 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.807945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:04.873213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865edbf-bc05-4a74-8dbe-419b7e1039b9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.895508 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141e54b-4229-4c1a-87ea-2cf5411d5f6c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.908549 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.909185 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.909458 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.909725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] PATH_INFO: `/v3/users/766eca6c90b14991bbab7620b31b39e0` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.910852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] RBAC: Authorizing `identity:get_user(user_id=766eca6c90b14991bbab7620b31b39e0)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.912340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.913922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 153/303] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/users/766eca6c90b14991bbab7620b31b39e0 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:04.920163 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.940685 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.941948 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.942822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.943246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.957621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:04.963738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:04.965455 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:04.966259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 151/304] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:04.966910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.985409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.052444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0765f-db2e-49ab-8301-c761b0334570 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.088884 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.096309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195efaa-7235-4370-bc6c-9a974fc81229 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.106838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.107960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.109996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.109996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.110437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.112800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.119553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 154/305] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.119553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.148594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.149263 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.149536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.149805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] PATH_INFO: `/v3/system/users/766eca6c90b14991bbab7620b31b39e0/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.151239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=766eca6c90b14991bbab7620b31b39e0, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.152688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.231327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903219e-976b-4c7e-b9ac-e44282a4743c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.251742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 152/306] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Aug 23 22:12:04 2022] PUT /identity/v3/system/users/766eca6c90b14991bbab7620b31b39e0/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:05.253848 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.270730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.271359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.271708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.271986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.272680 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:05.272976 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.274486 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.291313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 155/307] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.293318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.364838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.386696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.424815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f71438-4177-411f-83ba-4220cbb97852 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.435926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a424eca-ee0c-41a5-ba20-2a5bdacce633 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.479283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.479992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.480274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.480539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] PATH_INFO: `/v3/users/3a90f1b5206f4d65bb522016f54213ac` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.491861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.492480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.492760 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.493031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] PATH_INFO: `/v3/groups` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.493668 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.495115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f279-1732-487b-ade2-6b7ecbdf1882 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.497153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] RBAC: Authorizing `identity:get_user(user_id=3a90f1b5206f4d65bb522016f54213ac)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.498828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb45326-59a7-4380-9336-53132a33ca1f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.500607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 156/308] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/users/3a90f1b5206f4d65bb522016f54213ac => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:05.501826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193d2c-4b8e-4f01-bdf8-d5643c9304c4 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.502110 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193d2c-4b8e-4f01-bdf8-d5643c9304c4 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.502451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193d2c-4b8e-4f01-bdf8-d5643c9304c4 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.503786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 157/309] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:05.508829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193d2c-4b8e-4f01-bdf8-d5643c9304c4 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:05.579180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 153/310] 10.222.0.50 () {60 vars in 1134 bytes} [Tue Aug 23 22:12:05 2022] POST /identity/v3/groups => generated 229 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:05.580263 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.580547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.580821 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.608709 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:05.610005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:05.642798 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193d2c-4b8e-4f01-bdf8-d5643c9304c4 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:05.661699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:05.690105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 154/311] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:05.691172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, user.id=3a90f1b5206f4d65bb522016f54213ac, scope.system=all) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:05.697497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:05.701616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 158/312] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:05 2022] GET /identity/v3/role_assignments?user.id=3a90f1b5206f4d65bb522016f54213ac&scope.system=all&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:06.042695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.113405 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.163245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598bd9c9-8d34-4491-9cf9-1151222901eb None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.201103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.201862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.202140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.202409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.216017 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:06.221431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:06.222309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:06.223118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 155/313] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:06.228477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.368343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7688b-d20d-4fb0-91a2-ed981e454af4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.429953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.431005 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.431509 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.431980 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.434422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:06.434988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.437553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.453213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 159/314] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:06.462856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.587167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9698-2f50-44b6-89ad-221d421dad40 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.626276 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.630268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.630925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.631201 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.631474 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] PATH_INFO: `/v3/users/627c12a8be94481e8c1397b69fd7f0ae` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.632677 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] RBAC: Authorizing `identity:get_user(user_id=627c12a8be94481e8c1397b69fd7f0ae)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.634283 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.637424 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 156/315] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/users/627c12a8be94481e8c1397b69fd7f0ae => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:06.642274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:06.694778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.765420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5e2c-0591-4bb3-89ae-9c378335f63b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:06.803510 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:06.804315 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:06.804599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:06.804872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:06.885588 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:06.887647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:06.932495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:06.998713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 160/316] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:07.004888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.129163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30face54-b96d-4a73-b27a-9cdd5721314b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.165881 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.166437 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.166710 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.166977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.168751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.170189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a88763-364f-41b0-9efc-0a3a21d9ff8d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.172178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 157/317] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:07 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:07.177753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:07.299353 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262e38b-e3dd-4b03-8c76-0cca7823ed76 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:07.349340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:07.350147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.350516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.350851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.351895 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, scope.project.id=d32aa251c36c4e33aaaba51c829c054d, user.id=627c12a8be94481e8c1397b69fd7f0ae) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:07.352271 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:07.354128 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c528-1a45-43e2-8a84-2ff817d7b528 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:07.362096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 161/318] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:07 2022] GET /identity/v3/role_assignments?user.id=627c12a8be94481e8c1397b69fd7f0ae&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:07.887317 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8100-a554-4f49-bd4d-e6d512df0c5e None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.887773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8100-a554-4f49-bd4d-e6d512df0c5e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.887938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8100-a554-4f49-bd4d-e6d512df0c5e None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.889553 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 158/319] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:07.895562 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af523a-ab6f-46fe-8f58-2793fd1ff672 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:07.895901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af523a-ab6f-46fe-8f58-2793fd1ff672 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:07.896111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af523a-ab6f-46fe-8f58-2793fd1ff672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:07.903934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:07.921090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-61af523a-ab6f-46fe-8f58-2793fd1ff672 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:07.921090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-61af523a-ab6f-46fe-8f58-2793fd1ff672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:08.004849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 162/320] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:08.061024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde6cd-afa3-42d3-8de9-37d06d05262b None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.061452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde6cd-afa3-42d3-8de9-37d06d05262b None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.061572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde6cd-afa3-42d3-8de9-37d06d05262b None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.063169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 159/321] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:08.068868 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa494d-6593-41a7-8fd5-11def0424487 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.069169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa494d-6593-41a7-8fd5-11def0424487 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.069422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa494d-6593-41a7-8fd5-11def0424487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.090719 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-3ffa494d-6593-41a7-8fd5-11def0424487 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:08.092240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-3ffa494d-6593-41a7-8fd5-11def0424487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:08.177773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 163/322] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:08.347341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fde6cd-afa3-42d3-8de9-37d06d05262b None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.384078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63d5-d4e8-4fb5-bc65-6bd9c76338de None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.384639 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63d5-d4e8-4fb5-bc65-6bd9c76338de None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.385191 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63d5-d4e8-4fb5-bc65-6bd9c76338de None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.387282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 164/323] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:08.393282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.393623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.393865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.415173 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:08.416443 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:08.425847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.485528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fde6cd-afa3-42d3-8de9-37d06d05262b None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.493075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.509568 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 165/324] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:08.517331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.527789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.528488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.528729 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.529002 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.543774 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:08.551417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:08.552408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:08.553219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:08.556698 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 160/325] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:08.559764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.647760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eb843-1a73-4a67-9e42-ff15eb5cd747 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.701089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.701738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.702028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.702136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672699bf-3580-40d4-8872-91b49f0d8d06 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.702283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.715706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:08.720587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:08.721575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:08.722354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 166/326] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:08.729526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.739204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.762642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.763271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.763585 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.763858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.764545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:08.764840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.766357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.779366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 161/327] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:08.785434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.801149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.867898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba193562-1842-4b25-81e6-7530bd685800 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.915820 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.916555 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.916924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.917915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.918785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] RBAC: Adding query filter params (name=reader) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:08.919161 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.920923 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.922230 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac98602-97a1-47fd-afbc-6fac66d758d7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.930711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 167/328] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:08.931693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.961661 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.962420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.962694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.962978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] PATH_INFO: `/v3/users/766eca6c90b14991bbab7620b31b39e0` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.964767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] RBAC: Authorizing `identity:get_user(user_id=766eca6c90b14991bbab7620b31b39e0)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.966471 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.968790 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 162/329] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/users/766eca6c90b14991bbab7620b31b39e0 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:08.969388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.025940 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.047017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8d4e-7882-4be9-9b18-3bd813a403af None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.062655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.085217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a946-f083-407d-8849-4e5251b6a09f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.087953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.089297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.089297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.089297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.091285 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.093106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.094781 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 168/330] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.095697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.127447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.128108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.128410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.128685 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] PATH_INFO: `/v3/users/3a90f1b5206f4d65bb522016f54213ac` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.129855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] RBAC: Authorizing `identity:get_user(user_id=3a90f1b5206f4d65bb522016f54213ac)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.131416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.133086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 163/331] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/users/3a90f1b5206f4d65bb522016f54213ac => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.133846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.212906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01e487-2cda-4265-bb98-c4c9482078ae None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.252968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42034058-72e5-4e8b-8ccd-355efb46c6be None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.253181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.253715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.253996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.254270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.255046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] RBAC: Adding query filter params (role.id=2024dabf177244f1926c4f4a4f9efacc, user.id=766eca6c90b14991bbab7620b31b39e0, scope.system=all) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:09.255367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.256903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.271563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.275067 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 169/332] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:09 2022] GET /identity/v3/role_assignments?user.id=766eca6c90b14991bbab7620b31b39e0&scope.system=all&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:09.276500 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:09.293634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.294275 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.294550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.294816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] PATH_INFO: `/v3/groups` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.295603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.297155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9dffa-7be3-4959-a7f2-540354387e63 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.345216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:09.409864 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 164/333] 10.222.0.50 () {60 vars in 1134 bytes} [Tue Aug 23 22:12:09 2022] POST /identity/v3/groups => generated 226 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:09.433454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089c54-946c-4979-9cb7-a0b311a0d30d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:09.485201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:09.485824 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:09.486720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:09.486720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] PATH_INFO: `/v3/system/users/3a90f1b5206f4d65bb522016f54213ac/roles/c1184cf6c6cc49eaa3d8b6dae2895289` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:09.488794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a90f1b5206f4d65bb522016f54213ac, role_id=c1184cf6c6cc49eaa3d8b6dae2895289)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:09.490248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7d01e-353f-40e4-8c91-79923c95d87d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:09.568249 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 170/334] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Aug 23 22:12:09 2022] PUT /identity/v3/system/users/3a90f1b5206f4d65bb522016f54213ac/roles/c1184cf6c6cc49eaa3d8b6dae2895289 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:12.131037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ebab3-2bac-4032-951d-eb333f6977c5 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.131964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ebab3-2bac-4032-951d-eb333f6977c5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.132457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ebab3-2bac-4032-951d-eb333f6977c5 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.134355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 165/335] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:12.140829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64a73-270a-4b27-b09f-68cc72fcd9a6 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.141365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64a73-270a-4b27-b09f-68cc72fcd9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.141365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c64a73-270a-4b27-b09f-68cc72fcd9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.170542 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-53c64a73-270a-4b27-b09f-68cc72fcd9a6 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:12.172267 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-53c64a73-270a-4b27-b09f-68cc72fcd9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:12.277925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 171/336] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:12.719127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62158-14d1-40d3-bad5-808175ef3499 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.720041 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62158-14d1-40d3-bad5-808175ef3499 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.720717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62158-14d1-40d3-bad5-808175ef3499 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.722755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 166/337] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:12.728607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:12.728916 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:12.729162 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:12.759248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:12.760513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:12.803540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:12.869396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 172/338] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:13.033288 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f62158-14d1-40d3-bad5-808175ef3499 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.174602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f62158-14d1-40d3-bad5-808175ef3499 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.223950 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.224611 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.224895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.225170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.248704 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:13.253615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:13.254545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:13.255315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 167/339] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:13.261672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.492842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715347-1830-4a8b-848c-5538dc2dbd1a None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.562034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.562901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.563560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.563918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.564856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:13.565270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:13.567584 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0197e-1989-46be-946f-c8650ee8a272 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:13.582161 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 173/340] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:13.587914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.604788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961cb9-8677-4a7f-a619-030ad4d7d43a None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.609728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961cb9-8677-4a7f-a619-030ad4d7d43a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.609728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961cb9-8677-4a7f-a619-030ad4d7d43a None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.609728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 174/341] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:13.625939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.626283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.626497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.664821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:13.666253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:13.685039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.699883 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:13.769309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 175/342] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:13.770893 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:13.815008 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e58c5b-190d-4b74-b532-05dc88520210 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.872326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.873338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.873871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.874380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:13.932257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99529009-5c2c-481b-b25a-eb3527970d0e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:13.990531 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:13.991195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:13.991477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:13.991771 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.008991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.010626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ebacf-1d83-4102-af3a-73855b7cfa62 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.024941 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-2e4e174d-f4cb-4ff0-8202-4ecb2834d249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:14.034713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:14.035714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:14.036481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:14.046141 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 176/343] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:14.051304 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ac6a-bfe4-41e2-a213-be65e41ef364 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.051830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ac6a-bfe4-41e2-a213-be65e41ef364 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.052312 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3ac6a-bfe4-41e2-a213-be65e41ef364 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.056705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 177/344] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:14.061864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3ac6a-bfe4-41e2-a213-be65e41ef364 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.114751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.115793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.272222 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 168/345] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:14.274175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.274465 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.274740 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.315787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:14.317045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:14.323058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3ac6a-bfe4-41e2-a213-be65e41ef364 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.381555 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.383188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.387065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.387816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.388978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:14.389743 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.392362 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.410079 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 169/346] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:14.410998 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.411643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 178/347] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.413087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.510985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.517147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.542866 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30544e1-818c-448c-bd34-6507e3f7536e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.569591 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eaa0f-a8fc-4f18-9d8e-e08ffb9fe266 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.619322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.620129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.620408 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.621499 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.647403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:14.656827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:14.657877 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:12:14.658729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:14.663344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.664040 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.664318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.664588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.666012 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.668241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.669903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 179/348] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:14.671607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.673110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 170/349] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.681773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.894003 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a432eb-1edc-4312-8ad1-05941700b0f2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.910707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c0432-54c1-421b-b9e7-12b990154732 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:14.944696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.945346 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.945620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.945886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.948825 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:14.955426 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:14.957101 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:14.961962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 171/350] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:14.962755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:14.981424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:14.986338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.986338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.986338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.002617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.111458 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.112268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de56dc-8b52-4206-a85e-8f6e51108f5e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.112965 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.156748 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.157809 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.158292 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.158756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.159861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:15.160400 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.162150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc3f02-99a4-4362-9186-91f0ac46623d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.175524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 172/351] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.177450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b68a1-1011-47cd-af71-a1ba13f8b6e6 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.178022 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b68a1-1011-47cd-af71-a1ba13f8b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.178492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b68a1-1011-47cd-af71-a1ba13f8b6e6 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.180225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 173/352] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:15.181363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b68a1-1011-47cd-af71-a1ba13f8b6e6 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.264782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 180/353] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:15.264999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.265605 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.327256 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.329094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b68a1-1011-47cd-af71-a1ba13f8b6e6 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.378047 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.378678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.378962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.379235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.380010 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=c68afc4e23fd4e879b16363134aaaca5) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:15.380317 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.381789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566b20-1ede-40b4-8b01-ce336d381f4e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.391773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 174/354] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.395877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498696d-602d-4985-99be-be61603d85d9 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.396482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498696d-602d-4985-99be-be61603d85d9 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.396886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498696d-602d-4985-99be-be61603d85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.419970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5498696d-602d-4985-99be-be61603d85d9 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:15.421358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5498696d-602d-4985-99be-be61603d85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:15.425826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861cf45-b6a0-46aa-8ada-4b408bb2e7d3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.484043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.484700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.484978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.485282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.500261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:15.505762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:15.506735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:15.507761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 181/355] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:15.509272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.525610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 175/356] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:15.527412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b94d7-d080-4489-9c8d-3caa26194e88 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.529397 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b94d7-d080-4489-9c8d-3caa26194e88 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.530211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b94d7-d080-4489-9c8d-3caa26194e88 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.532055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 176/357] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:15.533366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b94d7-d080-4489-9c8d-3caa26194e88 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.631968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.652416 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.657366 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1f26-e5a7-43b4-950b-5071e8fd8dc4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.698031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b94d7-d080-4489-9c8d-3caa26194e88 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.704167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.708339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.708339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.708339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] PATH_INFO: `/v3/users/3a90f1b5206f4d65bb522016f54213ac` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.708339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] RBAC: Authorizing `identity:get_user(user_id=3a90f1b5206f4d65bb522016f54213ac)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.711209 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.713064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 182/358] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/users/3a90f1b5206f4d65bb522016f54213ac => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.714602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.760651 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.762063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.762402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.762683 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.764798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.767838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b9b2a-1c54-46bc-8061-29d27eeb5aae None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.770110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 177/359] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.771334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.771691 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.772910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.799290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:15.800918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:15.874976 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848bf70-49ba-4724-9265-84e5c02dee26 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:15.892123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 178/360] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:15.893200 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.929100 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:15.929724 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:15.930000 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:15.930275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:15.931069 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:15.931525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:15.932907 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:15.948591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 183/361] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:15.950600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:15.968403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:15.999477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.036762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42cb1e-a945-4a56-beef-7ee84b6e942a None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.082573 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.083208 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.083507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.083778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.085118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] RBAC: Adding query filter params (role.id=c1184cf6c6cc49eaa3d8b6dae2895289, user.id=3a90f1b5206f4d65bb522016f54213ac, scope.system=all) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:16.085422 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.086919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.104091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 179/362] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/role_assignments?user.id=3a90f1b5206f4d65bb522016f54213ac&scope.system=all&role.id=c1184cf6c6cc49eaa3d8b6dae2895289 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.105521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.111467 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74be0-ad80-4930-be29-d5df299f9520 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.166109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.167177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.168215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.168690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.170991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.173221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.176711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 184/363] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:15 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.178270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.253871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980265dc-c5cd-456e-970b-66c910f3e821 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.268394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.312717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.313410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.313695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.314270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.329591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.339516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acc1e-ed2c-4726-87c3-06ed6d113472 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.344436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:16.356978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:16.357943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:16.358744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:16.361094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 180/364] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:16.362245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.396503 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.397750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.398212 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.398593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.520675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.522228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.530998 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812f8c5-b018-4cb6-b3af-1fbafec1f6fe None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.586228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.587301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.588713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.589328 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.591229 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=d32aa251c36c4e33aaaba51c829c054d) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:16.591991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.594117 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.601584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 181/365] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.603051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.651030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.668909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.676317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 185/366] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:16.677327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.745846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb23791-2fa2-4184-850d-8a9e16ad3461 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.788887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.789919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.790582 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.791077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.792219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:16.793142 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.794757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.805053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 182/367] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.806286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.873418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f00a0-a390-49d6-9ddb-41f24980fdb5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.922215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.922907 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.923316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.923767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.929562 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:16.936380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0838f-3a24-4953-b69f-9bb7b5280337 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:16.938379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:16.943187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:16.944444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:16.945235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 186/368] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:16.951422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:16.984952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:16.986118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:16.986595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:16.987080 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:16.989013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:16.990851 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:16.993284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 183/369] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:16.994361 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.029124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.100469 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35ba06-3aae-45c5-9dcc-2c7b804177b7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.123286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc95d7-3b94-4359-a509-d2ad77ae0767 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.142004 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.142623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.142899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.143170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.171622 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.172836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.173462 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.174006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.174992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:17.175614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.177490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.188885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 184/370] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.190198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.225830 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.229628 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.231734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.295928 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.308708 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf13e9-5888-4086-9dad-ea2aaac74a1f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.349476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.350102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 187/371] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:17.351008 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.351701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.357254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.357995 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.359544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.361309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.363567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 185/372] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.364706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.470031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.471400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857a6a-2b2a-4fbd-b225-f4bb0b8311c1 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.478521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ccefb-1708-417b-a1cb-ced00b36a0d5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.513115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.513743 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.514017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.514336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.518675 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.519780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.520258 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.520782 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.522244 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.524015 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.525974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 186/373] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.530649 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.547470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.618359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.619767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.647871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf392801-cbc8-4bd5-9965-f44e3024718c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.688965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.689959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.690493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.690963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.692007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=c68afc4e23fd4e879b16363134aaaca5) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:17.692611 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.694322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.703579 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 187/374] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=a9bec09308a644beaccd586133840a4e => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.704893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.740441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:17.831803 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689246-7572-4b44-99e2-0085ac426841 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:17.834382 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 188/375] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:17.843216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.876838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:17.877839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:17.878313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:17.878869 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:17.880426 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:17.882355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:17.887126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 188/376] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:17.893631 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:17.952818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.024958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700ea3-5c07-474f-b382-70a184c3b87e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.071335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.072016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.072296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.072567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] PATH_INFO: `/v3/projects/91d06c9416144a16ae9ac55e441f6e94` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.073766 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] RBAC: Authorizing `identity:get_project(project_id=91d06c9416144a16ae9ac55e441f6e94)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.075219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.080754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 189/377] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/projects/91d06c9416144a16ae9ac55e441f6e94 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:18.084648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.128130 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.141895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0651-0114-4cb0-bee2-702a95847ab8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.196991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.197882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.198283 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.198697 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.200462 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=d32aa251c36c4e33aaaba51c829c054d) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:18.200941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.203836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.215616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 189/378] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:17 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=a9bec09308a644beaccd586133840a4e => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:18.220455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c415f-3f8f-4302-9174-478619e9d3cb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.254806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:18.275140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.275817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.276090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.276354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] PATH_INFO: `/v3/groups/2d09742200b84eae8c151a1a329cffb2` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.288388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] RBAC: Authorizing `identity:get_group(group_id=2d09742200b84eae8c151a1a329cffb2)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.290321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f654d-eed0-4651-8d20-4285960aa3b6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.292697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 190/379] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:18 2022] GET /identity/v3/groups/2d09742200b84eae8c151a1a329cffb2 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:18.299081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:18.432955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049477f3-1e51-4e55-ad09-14998f333e55 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:18.479100 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:18.479791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.480636 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.480907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.481651 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] RBAC: Adding query filter params (group.id=2d09742200b84eae8c151a1a329cffb2, role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=91d06c9416144a16ae9ac55e441f6e94) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:18.481954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:18.483523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb064b-c43e-4980-8ac6-96304551ba15 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:18.490235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 190/380] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:18 2022] GET /identity/v3/role_assignments?group.id=2d09742200b84eae8c151a1a329cffb2&scope.project.id=91d06c9416144a16ae9ac55e441f6e94&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:18.864984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254688-b553-4ca3-a04d-bd8d004c25eb None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.865553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254688-b553-4ca3-a04d-bd8d004c25eb None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.865553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254688-b553-4ca3-a04d-bd8d004c25eb None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.867130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 191/381] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:18.874379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3bc2-d310-41e6-b536-a6e67b07172e None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:18.874681 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3bc2-d310-41e6-b536-a6e67b07172e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:18.874936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3bc2-d310-41e6-b536-a6e67b07172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:18.898350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-feac3bc2-d310-41e6-b536-a6e67b07172e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:18.899650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-feac3bc2-d310-41e6-b536-a6e67b07172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:18.926173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:19.001299 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 191/382] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:19.424629 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd254688-b553-4ca3-a04d-bd8d004c25eb None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:19.594591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd254688-b553-4ca3-a04d-bd8d004c25eb None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:19.615587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2d90-22b7-4b05-8be7-b5ebe9ad73b3 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.616091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2d90-22b7-4b05-8be7-b5ebe9ad73b3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.616574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f2d90-22b7-4b05-8be7-b5ebe9ad73b3 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.619090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 192/383] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:19.627452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.628000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.628475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.650837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:19.651514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.651783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.652099 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.668520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:19.674126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:19.685762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:19.699385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:19.700378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:19.701151 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:19.702139 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 192/384] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:19.707272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:19.792409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:19.892873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42721140-2f2f-401a-aea2-a846ba6eeb35 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:19.898980 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 193/385] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:19.966898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:19.967851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.968333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.968664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.969852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:19.970175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:19.971649 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:19.988606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:19.989415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 193/386] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:20.140513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:20.166566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae9b7-7de7-4b74-81ca-c9e230e530e4 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:20.215445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:20.216798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.217403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.217877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.220654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:20.222542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:20.224738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 194/387] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:19 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:20.233190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:20.389121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e3c5-3abe-4b0c-ba5b-1209c1501fe5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:20.403121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:20.442958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:20.443656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.443941 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.444217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.445553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:20.447295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:20.450409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 194/388] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:20 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:20.461863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:20.686620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4eff9-d446-4e2f-b06a-c11595f74ea5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:20.723582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:20.801874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:20.802578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.802863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.803140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/groups/190e800eddac4147b9f110151f9143a7/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.810007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, group_id=190e800eddac4147b9f110151f9143a7, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:20.811824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:20.898814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 195/389] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:20 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/groups/190e800eddac4147b9f110151f9143a7/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:20.994493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a13f3-bce5-4e65-99e7-764396130369 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.072705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.073734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.074251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.074753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.105083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:21.116583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:21.119748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:21.123303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 195/390] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:21.131528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.168173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.323560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9f35-32de-46ea-a738-33ff6a97104a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.401385 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.402474 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.402970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.403435 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.404653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] RBAC: Adding query filter params (name=member) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:21.405203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.407847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.425964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 196/391] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:21.439182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.551682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.660974 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b7054-1a20-42f9-8911-2c3f96aa1206 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.726324 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.726975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.727257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.727558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.732394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.733896 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be88c83-1d4c-4f79-a1b8-c0c762a92d6b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.735992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 196/392] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:21.744652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.753672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7012-ba95-4fbe-a776-2f35bc2348bc None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.754055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7012-ba95-4fbe-a776-2f35bc2348bc None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.754294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7012-ba95-4fbe-a776-2f35bc2348bc None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.755667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 197/393] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:21.764014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce07b-0149-444a-9712-0cc59ed02f0d None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.764272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce07b-0149-444a-9712-0cc59ed02f0d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.764568 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fce07b-0149-444a-9712-0cc59ed02f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.800701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-b8fce07b-0149-444a-9712-0cc59ed02f0d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:21.801954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-b8fce07b-0149-444a-9712-0cc59ed02f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:21.836650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:21.863072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880b99d-9f9f-45a7-94ff-030c5463e992 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:21.892296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 198/394] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:21.893951 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837303-5638-478c-bb5f-436271f948a4 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.894391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837303-5638-478c-bb5f-436271f948a4 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.894792 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837303-5638-478c-bb5f-436271f948a4 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.896303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 199/395] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:21.903166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd481bf-c360-486c-960e-e6c75fc37ad9 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.903777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd481bf-c360-486c-960e-e6c75fc37ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.904200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd481bf-c360-486c-960e-e6c75fc37ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.921086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:21.921758 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:21.922108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:21.922450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:21.925079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fbd481bf-c360-486c-960e-e6c75fc37ad9 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:21.925855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:21.926680 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fbd481bf-c360-486c-960e-e6c75fc37ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:21.927545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:21.934910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 197/396] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:21 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:21.949243 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:21.972204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.031621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 200/397] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:22.213456 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b65567-99b5-4512-8d75-a58d85b0b341 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.228496 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4b9-0f55-4b1b-8828-0a385e77fc8c None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.229055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4b9-0f55-4b1b-8828-0a385e77fc8c None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.229564 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4b9-0f55-4b1b-8828-0a385e77fc8c None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.233169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 201/398] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:22.241219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.241747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.242290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.273116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.274023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.274401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.274775 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/groups/190e800eddac4147b9f110151f9143a7/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.277679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, group_id=190e800eddac4147b9f110151f9143a7, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:22.279742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:22.296992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:22.298785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:22.382971 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 202/399] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:22.383241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.384347 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.386977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 198/400] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:21 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/groups/190e800eddac4147b9f110151f9143a7/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:12:22.563591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.575745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13698c-36d8-4605-8fdb-0a94b16e6c20 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.635111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.635773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.636045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.636430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.653784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:22.659052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:22.660016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:22.660796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:22.663239 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 203/401] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:22.668772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.670815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.800117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a1809-8526-49d9-bf2e-fe6568576fd8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.870076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.870588 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.870900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.871173 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:22.871975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:22.872277 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:22.873703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:22.878680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b29b0f-0728-4920-be8b-53eb1e7817b6 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:22.899457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 204/402] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:22.905163 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:22.968226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:22.974511 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:22.976436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:22.977181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:22.977678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.010160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:23.019183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:23.020861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:23.022357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 199/403] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:23.032312 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.110711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02880500-bae7-40bb-906d-808eee2c7e67 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.120808 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.153179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.154087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.154565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.154970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.156418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.158210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.164709 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 205/404] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:22 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.166264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.176399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eecc6-93a3-4c21-9c01-28a63b20d333 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.215466 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.216486 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.216728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.216997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.217679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:23.218023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.219649 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.229426 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 200/405] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.231522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.284618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.303356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0628-bb46-42bd-893b-4d0d03b28800 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.344632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.345604 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.346045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.346525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.352572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8caf4-7c1f-4519-ae29-a348df5b3dfb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.359815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:23.364894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:23.365990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:23.366934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:23.374396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 206/406] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:23.375642 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.389176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.406063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.407003 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.407518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.407771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.409557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.412159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.414847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 201/407] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.420373 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.500867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb79e68-8bcf-4e1e-b315-8cf6090990e5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.542801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.543730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.544145 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.544607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] PATH_INFO: `/v3/groups/2d09742200b84eae8c151a1a329cffb2` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.546062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] RBAC: Authorizing `identity:get_group(group_id=2d09742200b84eae8c151a1a329cffb2)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.547774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.552570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 207/408] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/groups/2d09742200b84eae8c151a1a329cffb2 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.552570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.569535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.581148 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2774770-691c-46d4-ad9c-c88352364862 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.642319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.643126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.643642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.644166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.645430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:23.645852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.647861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.669559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 202/409] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.671172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.673479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50040b4d-2abf-4da8-8fda-36cf4a0d1097 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.714051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.715200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.715684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.716213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5/groups/190e800eddac4147b9f110151f9143a7/roles/a9bec09308a644beaccd586133840a4e` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.719166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] RBAC: Authorizing `identity:create_grant(project_id=c68afc4e23fd4e879b16363134aaaca5, group_id=190e800eddac4147b9f110151f9143a7, role_id=a9bec09308a644beaccd586133840a4e)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.720868 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.760765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.818964 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 208/410] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:23 2022] PUT /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5/groups/190e800eddac4147b9f110151f9143a7/roles/a9bec09308a644beaccd586133840a4e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:23.825009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.847475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1a41c-382f-48bf-a7b7-c15d6d4d7f25 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:23.928864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:23.942688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:23.944532 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:23.945125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:23.950586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] PATH_INFO: `/v3/projects/91d06c9416144a16ae9ac55e441f6e94` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:23.950586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=91d06c9416144a16ae9ac55e441f6e94)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:23.951283 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:23.954395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 203/411] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/projects/91d06c9416144a16ae9ac55e441f6e94 => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:23.962874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:23.997997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d912bfe-5e01-42f4-818f-bae980867fbf None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.084656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.085511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.085851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.086172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.088074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.090311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.092431 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 209/412] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:23 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:24.099974 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.150282 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffecb2-4452-43eb-b737-dfff6edae1b7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.178376 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.197897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.198706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.199162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.199527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] PATH_INFO: `/v3/projects/91d06c9416144a16ae9ac55e441f6e94/groups/2d09742200b84eae8c151a1a329cffb2/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.206964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] RBAC: Authorizing `identity:create_grant(project_id=91d06c9416144a16ae9ac55e441f6e94, group_id=2d09742200b84eae8c151a1a329cffb2, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.208863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.261735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4364-cb34-44df-83d3-51f21486790c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.296500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 204/413] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:23 2022] PUT /identity/v3/projects/91d06c9416144a16ae9ac55e441f6e94/groups/2d09742200b84eae8c151a1a329cffb2/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:24.309049 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.309801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.310079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.310344 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.311735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.313363 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd40d8-f196-44be-bc75-f77b25efb709 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.315981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 210/414] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:24 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:24.322461 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:24.452055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711cba1-dfbc-4e5d-9bc6-44572bb1bd64 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:24.484445 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666504-9abb-432d-bcfe-0329c788ddf3 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.484778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666504-9abb-432d-bcfe-0329c788ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.484983 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666504-9abb-432d-bcfe-0329c788ddf3 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.486608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 211/415] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:24.492693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93090d-edd1-42bf-a60c-86788876cd32 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.492863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93090d-edd1-42bf-a60c-86788876cd32 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.493164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93090d-edd1-42bf-a60c-86788876cd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.505906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:24.507030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.508055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.509444 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d/groups/190e800eddac4147b9f110151f9143a7/roles/a9bec09308a644beaccd586133840a4e` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.518854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32aa251c36c4e33aaaba51c829c054d, group_id=190e800eddac4147b9f110151f9143a7, role_id=a9bec09308a644beaccd586133840a4e)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:24.520766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:24.532528 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-3c93090d-edd1-42bf-a60c-86788876cd32 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:24.534300 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-3c93090d-edd1-42bf-a60c-86788876cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:24.539579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.614500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 205/416] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Aug 23 22:12:24 2022] PUT /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d/groups/190e800eddac4147b9f110151f9143a7/roles/a9bec09308a644beaccd586133840a4e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:24.632169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 212/417] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:25.021673 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.090328 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.149624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed160c5-7dfa-4696-84e6-3967c82de5be None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.149954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed160c5-7dfa-4696-84e6-3967c82de5be None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.150176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed160c5-7dfa-4696-84e6-3967c82de5be None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.153497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 213/418] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:25.158259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.162740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.162740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.185841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:25.187057 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:25.187237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb4dc-2de3-42c0-aef0-63124791bf22 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.265182 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.266318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.266816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.267320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.303136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 214/419] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:25.304656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:25.311132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:25.312459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:25.313237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 206/420] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:25.318407 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.403130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.436832 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e8221-4d20-4274-9944-b13a5085f9db None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.479813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.481009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.481283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.481550 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.482595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:25.482970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.484500 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:25.496305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 215/421] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:25.504403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.682354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.688571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986093-97f5-4965-a96e-3c4cf2bed539 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.744590 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.745634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.746815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.747277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.827100 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.871828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.873779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.021026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2cdbf-ad31-443f-896e-8ba50328c62c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.058379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.059421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.060009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.063724 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.064755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.079224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:26.085084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:26.086084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:26.087274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 216/422] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:26.097948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.138209 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.156188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 207/423] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:26.165061 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.216854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c651-02c6-43ea-9907-7501e76b80f3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.256685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.257577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.258157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.258605 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.259450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] RBAC: Adding query filter params (name=member) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:26.259944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.262562 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.272793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 217/424] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:26.283652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.358246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.401835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839f76-3e37-4d58-a40e-072694b0f07e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.447317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.448254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.448727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.449272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.498521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ebb35-f7c5-483f-9748-0501cf8b93dd None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.541923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.544248 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.545441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.545894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.549969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.551733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.555340 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 208/425] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:26.561261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.610630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.612451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.679888 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.732926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 218/426] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:26.738834 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.763574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:26.856921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd5d9-039a-4ee4-ad5b-27ea9371914d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.857841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f68a-5096-4dc3-b33a-e7ad6c2a0b19 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:26.895984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.897058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.897569 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.898078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.899688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.901441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.904423 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 219/427] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:26.914687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.914908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:26.914908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:26.914908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:26.915145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:26.918070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:26.919637 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.923373 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 209/428] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:26.928438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:26.987906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.131313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f164c-d841-4009-93bf-236663103234 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.147901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e432c7-bf81-42d3-9e70-242a678651c9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.201290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.201971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.202205 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.202481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.203284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=c68afc4e23fd4e879b16363134aaaca5) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:27.203740 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.205399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fb228-b4a8-446c-bb59-81948110d6dd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.208892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.211037 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.212589 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.213213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.213719 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.215557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 210/429] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 611 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:27.216501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.218448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.220779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 220/430] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:26 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:27.224402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b56ab-7384-4077-9be3-a4fdd7e0c66d None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.225133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b56ab-7384-4077-9be3-a4fdd7e0c66d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.231952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b56ab-7384-4077-9be3-a4fdd7e0c66d None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.231952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 211/431] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:27.233324 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.236331 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325eaf8-85c0-4f84-9e79-b663be4fe171 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.236635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325eaf8-85c0-4f84-9e79-b663be4fe171 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.236908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325eaf8-85c0-4f84-9e79-b663be4fe171 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.238941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 212/432] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:27.242119 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab733-61bd-4fdd-a6d5-1ccf63dc8a28 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.244887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab733-61bd-4fdd-a6d5-1ccf63dc8a28 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.245452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dab733-61bd-4fdd-a6d5-1ccf63dc8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.269737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-14dab733-61bd-4fdd-a6d5-1ccf63dc8a28 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:27.271873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-14dab733-61bd-4fdd-a6d5-1ccf63dc8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:27.376391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.392201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304bfc-3afa-478d-aafe-77bc4e957afc None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.404925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 213/433] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:27.405379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.405576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.405810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.446076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:27.447339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:27.457751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.458757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.459244 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.459785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.460766 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=2024dabf177244f1926c4f4a4f9efacc, scope.project.id=d32aa251c36c4e33aaaba51c829c054d) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:27.461776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:27.463954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadd426-0651-4c4b-a60a-69ae11e78105 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:27.472945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 221/434] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=2024dabf177244f1926c4f4a4f9efacc => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:27.488110 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fdc17-6ba8-4f06-83ef-476284d3db4f None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.488549 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fdc17-6ba8-4f06-83ef-476284d3db4f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.488881 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fdc17-6ba8-4f06-83ef-476284d3db4f None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.490321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 222/435] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:27.498039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.498323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.498747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.536652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:27.538567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:27.551956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 214/436] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:27.648627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 223/437] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:27.801090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.873644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:27.919259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff18d-6b29-4e8a-b0c4-61f298a1621d None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:27.937368 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:27.961073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:27.961958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.962401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.963315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.979214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:27.985141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:27.986147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:27.986947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:27.989306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 215/438] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:27.993593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.048317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.066695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780cd7a-1e71-4b74-abf3-d11cf5a27e1f None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.107588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3b23c-0ff1-4f6a-8424-9204d3a10611 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.109269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.109976 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.110256 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.110522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.122204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:28.127600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:28.128472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:28.129269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 224/439] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:28.130636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.131756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.146609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.146609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.146609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.146609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.147176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:28.147472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.148985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.158309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 216/440] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.159163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.253652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97bd6-0336-4800-9764-459408b603a9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.274229 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2440b9f-6561-4cbd-8ed5-1995118ea71f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.302697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.303319 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.303699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.303965 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.314710 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:28.316254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.316869 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.317149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.317422 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.318095 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:28.318406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:28.319402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:28.320364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:12:28.321770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:28.322965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.323088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 225/441] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:28.323088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.326645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.335956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 217/442] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.337211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.391959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.435278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21123226-db4a-43c5-ac74-795eb8656536 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.448742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c04f6-e976-4bec-b9f6-596c8d3d8b7e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.472360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.472979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.473261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.473537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.485648 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.486262 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.486549 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.486816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.487502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:28.487818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.489198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.498602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 218/443] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.499369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.555175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.555175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.555175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.612954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2179f1-89de-4fd4-8c13-75d233f944e8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.621550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.650405 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.651002 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.651278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.652858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.666672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 226/444] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:28.667712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.727941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.729396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.778964 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc2adf-79cf-4281-b60c-c130336e775d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.781415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.814022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.814671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.814940 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.815204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.835465 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 219/445] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:28.836343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.846984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:28.887070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.888619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.947286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cf0c2-7022-4cb0-be07-1873842bf323 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.984843 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.985572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.985860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.986135 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] PATH_INFO: `/v3/projects/c68afc4e23fd4e879b16363134aaaca5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.987605 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=c68afc4e23fd4e879b16363134aaaca5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.989158 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.990766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 220/446] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/projects/c68afc4e23fd4e879b16363134aaaca5 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:28.991593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.993498 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 227/447] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:28.996464 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.000076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.073934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.100160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892f6e-0d35-470d-909b-50db043e6cc0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.106698 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff8a3d-1de5-4977-a0fa-562ad6d31f51 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.135536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.136165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.137277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.137644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] PATH_INFO: `/v3/projects/91d06c9416144a16ae9ac55e441f6e94` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.138792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] RBAC: Authorizing `identity:get_project(project_id=91d06c9416144a16ae9ac55e441f6e94)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.140250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.141873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 221/448] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/projects/91d06c9416144a16ae9ac55e441f6e94 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.142629 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.147229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.147905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.148189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.148459 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.149631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.151078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.153460 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 228/449] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.158553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.238741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.252861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d847a-e43b-424c-b029-7029ccc84f24 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.270176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539740-2bcd-4d56-ae91-1ced4ce39911 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.287815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.288451 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.288727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.288994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] PATH_INFO: `/v3/projects/d32aa251c36c4e33aaaba51c829c054d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.290762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=d32aa251c36c4e33aaaba51c829c054d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.291596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.293900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 222/450] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/projects/d32aa251c36c4e33aaaba51c829c054d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.294668 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.309052 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.318634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.318634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.318634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.318634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] PATH_INFO: `/v3/groups/2d09742200b84eae8c151a1a329cffb2` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.319724 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] RBAC: Authorizing `identity:get_group(group_id=2d09742200b84eae8c151a1a329cffb2)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.321161 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.322732 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 229/451] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/groups/2d09742200b84eae8c151a1a329cffb2 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.323496 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.408939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86020ec-e462-447d-93ee-43b505bb8dd0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.429348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846133d-8697-49cb-8b22-36103ec2de64 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.443788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.444396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.444672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.444939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.445663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=c68afc4e23fd4e879b16363134aaaca5) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:29.445965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.447394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.454049 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 223/452] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=c68afc4e23fd4e879b16363134aaaca5&role.id=a9bec09308a644beaccd586133840a4e => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.454849 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.467797 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.468508 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.468773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.469402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] PATH_INFO: `/v3/groups/190e800eddac4147b9f110151f9143a7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.470675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] RBAC: Authorizing `identity:get_group(group_id=190e800eddac4147b9f110151f9143a7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.472225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.474123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 230/453] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/groups/190e800eddac4147b9f110151f9143a7 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.480134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.493882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.560325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.591581 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaee1f-3a36-475c-88fa-f2d1d21abe70 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.620691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bac8-6bbc-4b7f-bbd2-daa78af66531 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.642062 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.642778 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.643051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.643332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.644106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] RBAC: Adding query filter params (group.id=2d09742200b84eae8c151a1a329cffb2, role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=91d06c9416144a16ae9ac55e441f6e94) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:29.644418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.645858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d50489-f3c5-4d45-8c44-147c4cf2e9a7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.659598 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 224/454] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/role_assignments?group.id=2d09742200b84eae8c151a1a329cffb2&scope.project.id=91d06c9416144a16ae9ac55e441f6e94&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:29.675780 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.676419 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.676695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.676962 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.677787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] RBAC: Adding query filter params (group.id=190e800eddac4147b9f110151f9143a7, role.id=a9bec09308a644beaccd586133840a4e, scope.project.id=d32aa251c36c4e33aaaba51c829c054d) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:29.678097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:29.679800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46799-b7b9-49c2-a48d-2865b47412a7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:29.687709 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 231/455] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/role_assignments?group.id=190e800eddac4147b9f110151f9143a7&scope.project.id=d32aa251c36c4e33aaaba51c829c054d&role.id=a9bec09308a644beaccd586133840a4e => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:32.502957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38975c2-96c4-49a8-89bd-060e58202ca1 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.503525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38975c2-96c4-49a8-89bd-060e58202ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.503525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38975c2-96c4-49a8-89bd-060e58202ca1 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.505121 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 225/456] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:32.510713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f71-ae8a-4bb4-a0a7-48d40d21db27 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.511171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f71-ae8a-4bb4-a0a7-48d40d21db27 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.511269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd2f71-ae8a-4bb4-a0a7-48d40d21db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.534910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-33bd2f71-ae8a-4bb4-a0a7-48d40d21db27 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:32.536514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-33bd2f71-ae8a-4bb4-a0a7-48d40d21db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:32.614570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 232/457] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:32.836493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168699-93f1-49a6-8a0f-f3362e42b98d None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.836865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168699-93f1-49a6-8a0f-f3362e42b98d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.837051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5168699-93f1-49a6-8a0f-f3362e42b98d None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.838732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 226/458] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:32.844874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.850218 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.850218 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.852220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.866012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:32.867263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:32.925546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3acf3-4074-4a31-9c50-ff0499e57358 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.926031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3acf3-4074-4a31-9c50-ff0499e57358 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.926506 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3acf3-4074-4a31-9c50-ff0499e57358 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.929358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 227/459] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:32.939856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.940346 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.940718 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.960014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:32.961406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:32.968942 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 233/460] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:32.975328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.060609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 228/461] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:33.087078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596bdf-8e45-49e9-b434-4b8a165b678c None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.119734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.125882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.126553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.126954 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.136256 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.138175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.139705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:33.155920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:33.156853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:33.157691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:33.157691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.157691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:33.157691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 234/462] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:33.164632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.235144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.275723 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879c67f-22c3-4499-a4d3-3cff9b15b938 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.317325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.317961 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.318242 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.318516 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.319189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:33.319518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.320934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.336698 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 229/463] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:33.342946 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.374763 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.480943 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6aa5-d821-4f24-b0c7-fa3316890345 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.503094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908be1-8539-4ef7-bd32-735365c0da85 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.529341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.530029 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.530336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.530507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.531145 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.532652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.539844 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.548954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.549605 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.550452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.550452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.565938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.567406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:33.585286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:33.586900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:33.587835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:33.587835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.587835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:33.587835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 230/464] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:33.588569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.644184 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 235/465] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:33 2022] POST /identity/v3/users => generated 246 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:33.644953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.719933 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.747087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a2407-1ea5-4188-a25c-3889c26180e8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.775703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e24a0-90c7-4b16-befe-bbdbed009931 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.792080 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.792906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.793837 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.794561 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.809580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.811213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.821757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.822381 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.822659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.822987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.823712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:33.824040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.826178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:33.832525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:33.833488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:33.834358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:33.834358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:33.834358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:33.834358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 231/466] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:33.844974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.854552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 236/467] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:33.856896 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.903727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.995306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cac4-fad2-412a-bbc2-6f1ef9e3299d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.998857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.002676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4f937-8fc2-4cf1-b93e-ee3f4f7af410 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.040111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.041129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.041617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.042041 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.042903 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:34.043354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.044785 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.057010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.057644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 232/468] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:34.059022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.059306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.059605 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.060250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.061696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cb631-99a1-4677-a3ad-7d36882cb5eb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.063839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.166408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:34.180389 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8c2f4-4dd7-4dd5-916b-046b17ce143f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.228127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.228946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.229339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.229759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.231314 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.232897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd45ea6-31c8-46a1-bc08-3ebc9314abd6 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.266030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 237/469] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:33 2022] POST /identity/v3/users => generated 248 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:34.381007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 233/470] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:34 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:12:34.467635 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22f46-184a-4691-afd4-7f046b940ace None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.468071 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22f46-184a-4691-afd4-7f046b940ace None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.468571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22f46-184a-4691-afd4-7f046b940ace None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.472010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 238/471] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:34.481329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.481813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.482232 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.505856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:34.507411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:34.611806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 234/472] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:35.212744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22f46-184a-4691-afd4-7f046b940ace None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.404845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22f46-184a-4691-afd4-7f046b940ace None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.470149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.471127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.471661 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.472155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.491793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.494718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:35.524751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:35.526400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:35.528591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:35.528591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:35.528591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:35.528591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 239/473] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:35.537758 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.656091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:35.681324 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4da1f-07e9-4f7f-b56c-f011b30ae86d None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.721512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35759a09-b221-4a72-b056-a714835e944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.722054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759a09-b221-4a72-b056-a714835e944f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.722375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759a09-b221-4a72-b056-a714835e944f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.722654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35759a09-b221-4a72-b056-a714835e944f None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.723325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35759a09-b221-4a72-b056-a714835e944f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:35.723656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35759a09-b221-4a72-b056-a714835e944f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.725075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35759a09-b221-4a72-b056-a714835e944f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.741037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 235/474] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:35.750108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.767006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:35.884898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8eec8-1c54-4ca4-90ce-9a4d23ebb3b2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.927412 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.928180 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.928681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.929166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.930401 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.932947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77d528-9ce3-42c0-aa87-e75fc6628bc7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:36.022630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 240/475] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:35 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:36.212793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01736c3-94f5-4813-9909-b04986f5b076 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.213524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01736c3-94f5-4813-9909-b04986f5b076 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.214037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01736c3-94f5-4813-9909-b04986f5b076 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.216741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 236/476] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:36.223289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef319-f292-41db-8f3c-0c55025e2d0d None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.224092 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef319-f292-41db-8f3c-0c55025e2d0d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.224092 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef319-f292-41db-8f3c-0c55025e2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.252079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-896ef319-f292-41db-8f3c-0c55025e2d0d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.254281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-896ef319-f292-41db-8f3c-0c55025e2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.352823 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:36.364567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 241/477] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:36.772051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01736c3-94f5-4813-9909-b04986f5b076 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.896894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01736c3-94f5-4813-9909-b04986f5b076 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:36.938152 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:36.938724 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.938999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.939267 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.951734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:36.953312 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916042a-1c39-44c8-9d3d-eb72baf10b50 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.953598 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916042a-1c39-44c8-9d3d-eb72baf10b50 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.953872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916042a-1c39-44c8-9d3d-eb72baf10b50 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.956044 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 242/478] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b122f518-9b80-4573-9b3c-b3a52841ad72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:36.956599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:36.957535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:36.958339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:36.959011 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 237/479] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:36.964376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916042a-1c39-44c8-9d3d-eb72baf10b50 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.970658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768481-37ea-4256-a539-e576d6d782f5 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.970928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768481-37ea-4256-a539-e576d6d782f5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.971108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768481-37ea-4256-a539-e576d6d782f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.993791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d7768481-37ea-4256-a539-e576d6d782f5 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.995766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d7768481-37ea-4256-a539-e576d6d782f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:37.123190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 238/480] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:37.124854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d50-f8ea-47a9-a956-a3ebd7f307ed None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.125161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d50-f8ea-47a9-a956-a3ebd7f307ed None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.125395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9d50-f8ea-47a9-a956-a3ebd7f307ed None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.127020 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 239/481] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:37.132805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.133144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.133362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.172989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:37.174839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:37.200410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916042a-1c39-44c8-9d3d-eb72baf10b50 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.244491 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.245530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.245982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.246502 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.247476 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.247873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.249318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.258922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 243/482] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:37.266033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 240/483] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:37.266364 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.380027 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.431134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2013cc5-5dba-4f46-b301-ccb0e290c0c1 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.470135 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.470786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.471073 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.471341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.484324 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.485924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:37.503111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.509356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:37.510188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:37.510188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:37.510188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:37.510188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 244/484] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.511882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.523395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.595312 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.661643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74384af-343f-4e7e-9c84-1602c40e0575 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.689947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0677ab-978c-493e-b691-f09616b103a8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.702229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.737477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.738024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.738307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.738553 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.739829 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.741347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.742277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.743024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.744682 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.745765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.749513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.751261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:37.759072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.760294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:37.761117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:37.762781 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 245/485] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.769657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.790533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 241/486] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:37.790533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.891390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7746-3e7c-4a59-92d6-7f62e67cc26a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.928811 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.929441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.929716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.929991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.930660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.930966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.932394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.946618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 246/487] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:37.946618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.977140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3110-874b-4640-ba70-7e3ac312ba56 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.980106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.010732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.041853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.042812 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.043897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.044329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.059414 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:38.065247 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3120-23bb-4fc1-a001-7c52bf31a38c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:38.065996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.067619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 242/488] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.069168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.114776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.115413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.115721 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.115992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.124634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.126105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:38.141429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.142437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:38.143331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 247/489] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.143949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.193594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419ecf1-2659-43cf-aedf-c227134865d4 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.234183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.234851 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.235130 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.235404 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.251073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.253271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.270246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:38.274955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.276315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:38.277153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:38.277153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.277153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:38.281935 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 243/490] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.284195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.288855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f799646-5e54-4432-bfd9-a4ffeab1ad73 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.329244 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.330344 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.331061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.331397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.331784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.332530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:38.332826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.334243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.345433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 248/491] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:38.346411 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.438574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a0d2-8fe9-4d17-b5b6-6454e58e4576 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.478440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.479320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.483463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.483463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.483463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:38.483463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.484902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.496695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1f54d-4739-4be4-868c-c7ee7c2542bb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.533149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 244/492] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:38.534348 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.563344 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.564410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.564855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.565343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.566445 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:38.566979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.569610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.595155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 249/493] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:38.595155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.615616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.647937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.666014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c101e-81bf-4562-9a74-1cccfad2f5cf None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.716479 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.717309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.718203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.732359 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.734967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.752738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b34df7-85b6-418f-be66-72951d795806 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:38.756967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.758728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:38.760440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:38.760440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.760440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:38.765787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 245/494] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.767196 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.796097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.796620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.796902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.797166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.898909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18feb18-3748-4adb-a739-1c3af24a111a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.937836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.938431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.938710 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.938985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.942238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.945077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.947623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.949091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.954180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:38.966051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.967068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 246/495] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.969124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.974959 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.099687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 250/496] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:39.101835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.127539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce0f7b-9cc6-4e8d-9941-faee8105256b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.185892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.186899 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.187366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.187875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.189013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.189543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.192133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07192b-16c4-4cad-9dfd-c98bb2ad07bd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.213370 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 247/497] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.216067 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f578a7-0f5e-44c1-b228-70e66697beea None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.216548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f578a7-0f5e-44c1-b228-70e66697beea None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.217028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f578a7-0f5e-44c1-b228-70e66697beea None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.219720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 248/498] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:39.221077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f578a7-0f5e-44c1-b228-70e66697beea None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.237471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec270782-4c3d-40d6-b85e-1f7110afc1a3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.251873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.278803 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.279585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.279723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.279952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.280681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.281021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.282990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.320281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.327551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 251/499] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.331314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.393403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f578a7-0f5e-44c1-b228-70e66697beea None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.445559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.446310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.446697 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.447055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.456829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7ed2-aac6-492d-b58e-fb75882074af None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.462939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.466265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-efd455d2-c4e1-4b40-bcb3-411f96d823bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:39.492139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:39.493343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:39.494663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:39.494663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:39.494663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:39.494663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 249/500] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:39.495968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.497311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.497653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.518251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.518736 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:39.519230 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.519790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.520193 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.520682 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:39.531683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.534011 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:39.554592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:39.564392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 252/501] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:39.565603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.598779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.622842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 250/502] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:39.624495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.704271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.723076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ced9d-07e9-4a14-9e6f-55a014139b74 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.781105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.782711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.783175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.783676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.805965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908ef2-a0c7-4032-bd9b-20bb583b4c03 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.868761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.869657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.870058 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.870504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.872325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.872718 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.874292 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.888764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 251/503] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.889813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.890320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.893187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.948838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.022291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc545c60-a87a-43d4-b78e-77043160a733 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.024610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.072165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.073125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.073540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.074705 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.075985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:40.076424 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.078211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.091974 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 253/504] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:40.093775 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.111194 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 252/505] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.111194 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.221010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8927-47a1-4913-9603-0a15ccf6a27e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.253712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.259036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9657a9-6fa1-495b-ab50-5157a68c7480 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.271055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.271055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.271055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.271055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.274845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.277734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:40.302166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:40.303683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:40.304516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 254/506] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:40.304992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.305533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.305694 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.305946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.306445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.322236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.323751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:40.340231 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:40.341978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:40.343672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:40.343672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:40.343672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:40.343672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 253/507] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:40.343672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.374281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.451875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab562d-2e8d-41a6-b1d0-5d4cabc58ecc None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.481728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080b14d-3297-4ba3-bee4-7ac68eb7cef5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.498206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.499026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.499387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.499949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.530781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.531821 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.532220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.532618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.549668 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:40.558114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:40.560502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 254/508] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:40.562446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.593691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.609934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.612097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.673126 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.721699 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad1192-2ff3-436c-9af5-e56b4fa39a0e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.762493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.763265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.763600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.763875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.764590 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:40.764904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.766379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.768789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 255/509] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:40.770201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.788109 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 255/510] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.789043 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.883111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.894520 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadc915-ca00-466e-825d-7dd35c5ac5dc None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.939855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.940610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.940999 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.941354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.942131 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:40.942558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.944120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.957625 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 256/511] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:40.958600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:40.975468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7808fa-2cd8-4d91-aa91-efa53eabe7c2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.015433 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.021251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.021872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.022151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.022440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.023346 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.023525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.024937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.044720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 256/512] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.044720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.087992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf091-4a69-4b4e-9d33-8c96ffc17c19 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.146185 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.147250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.147787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.148281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.167957 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.171243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.183173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77572409-a167-47ba-8d3d-96564bae05cb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:41.199949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:41.201835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:41.202669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:41.202669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:41.202669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:41.202669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 257/513] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:41.204041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.208540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.234279 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.235314 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.235847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.236322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.237727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=64a888930adc468c9fbeaa51913de637) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.238280 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.241041 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.258488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 257/514] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/role_assignments?user.id=64a888930adc468c9fbeaa51913de637&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.258488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.361501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1428-266b-4cda-b9d9-205aedf0528a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.376085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.415112 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.416193 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.416669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.417114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.435643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.438552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:41.456952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:41.458281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:41.459158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:41.461546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 258/515] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:41.463300 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.473603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf5f8-346b-43ff-9eeb-d6dbf2656ecd None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.542947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.544574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.545105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.545631 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.558118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.566857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.569674 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:41.598300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:41.607388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:41.609294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:41.609294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:41.609294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:41.609294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 258/516] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:41.609294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.628770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f657-fd71-48ce-a948-7ca4f084f9b6 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.682251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.683318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.684456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.684955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.686200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.686762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.690412 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.718752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 259/517] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.720566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.798958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac9bcd-253e-4d37-b2b0-fcb650cd73d1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.821469 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.861204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.862461 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.862764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.863050 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.863830 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.864517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.866180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:41.885355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 259/518] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:41.887757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:41.919386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562e3e2-e3ba-4860-b286-0c115c0077ca None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:41.963631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:41.984444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:41.985567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.985972 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.986425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.987594 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:41.988105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:41.990407 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.011282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 260/519] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.012865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.128440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddad9fb-e8dc-46d2-9fc2-abdb45a12739 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.180031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.180958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.181411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.181842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.195706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.197611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b96b1e-f6c1-477b-8141-6ab03f10a8ad None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.198333 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:42.215838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:42.217728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:42.219411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 260/520] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:42.221605 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.280140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.281155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.281657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.282128 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.282894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=3b13ed7288ab43e08f7b842927e77d6b) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:42.283200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.285188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.291807 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 261/521] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/role_assignments?user.id=3b13ed7288ab43e08f7b842927e77d6b&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.292691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.304448 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.376843 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.440197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715a4b1-fc38-4d01-b748-4fb482be99f1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.488075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.489123 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.489587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.490036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.499717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.501727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:42.518298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:42.519472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:42.522537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:42.523718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1bd8b-85aa-4278-9c7f-8ea9939b402f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.525291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 261/522] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:42.525516 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.595229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.596446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.597054 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.597534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.598881 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:42.599424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.602481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.654069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.666622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 262/523] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.670752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.689179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96974a65-97c9-4bbc-8b2a-a641abec4973 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.756515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.756945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.757250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.757630 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.758559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:42.758871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.760795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.792746 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 262/524] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:42.798324 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.891348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50475358-9dac-4329-abbe-aae483c074ce None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.909063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:42.959092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57e58d-c715-416c-8af7-ed30249b7e0e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.963626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.964523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.965512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.965994 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.967311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=6f428da0321f49fa81fa70bcdddeaf3e) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:42.967836 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.970835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.987549 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 263/525] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/role_assignments?user.id=6f428da0321f49fa81fa70bcdddeaf3e&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:43.013184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:43.013841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.014134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.014548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.039537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:43.107144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:43.108814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:43.263131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 263/526] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:12:43.270121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:43.431613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c59e-39a1-4775-b3c2-d3bdb8f7e97b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:43.488886 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:43.489640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.489921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.490194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.505126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:43.506748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:43.530643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:43.531688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:43.532644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:43.532644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:43.532644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:43.533296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 264/527] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:43.538767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:43.613032 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:43.684064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe750c-d605-4071-a031-77cec16d0e81 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:43.729787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:43.730440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.731454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.731904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.732659 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:43.732969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:43.734567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:43.749737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 264/528] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:43.758456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:43.799845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:43.911920 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6061c-0dd0-4de4-9ec6-88107aedd0b2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:43.958854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:43.959514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.959844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.960117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.968784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:43.970545 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:43.987294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:43.988226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:43.989581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 265/529] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:43.997987 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:44.127806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9164ba-630e-48a5-8474-a863d63843b1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.144657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.167409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.168592 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.169032 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.169287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.169979 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:44.170446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:44.171968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4d45-d210-46d2-aaea-2202ebb65c12 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:44.185728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 265/530] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:44.191854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:44.289830 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb437-1088-4acf-9253-3e6c31fd99bf None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.290461 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb437-1088-4acf-9253-3e6c31fd99bf None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.290539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbb437-1088-4acf-9253-3e6c31fd99bf None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.292416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 266/531] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:44.301235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.301897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.302375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.304928 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.327153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:44.329550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:44.334052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadd043-6170-4e29-907a-e9871b0faf9a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.383236 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.383993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.384384 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.384730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.385633 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=b7eebced2e1c452abe1bd93520f0f6d8) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:44.386013 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:44.387745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:44.395633 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 266/532] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/role_assignments?user.id=b7eebced2e1c452abe1bd93520f0f6d8&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:44.460885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 267/533] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:44.872883 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.022945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50807fe6-2c97-4048-b1a5-d33c76e3bc2d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.065317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.066664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.067354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.068067 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.087652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-e19da9de-1914-42cb-8e59-6163e234a705 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:45.098753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:45.100389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:45.101909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:45.105893 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 267/534] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:45.116075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.281930 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.286515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652791ac-9d45-45bf-abdb-b5987b050514 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.332551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d580d-9b75-4a3f-9a04-953cad0759ea None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.332866 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d580d-9b75-4a3f-9a04-953cad0759ea None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.333103 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d580d-9b75-4a3f-9a04-953cad0759ea None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.334013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.334796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.335277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.335402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 268/535] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:45.335726 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.336530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:45.336837 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.338251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.343451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.343858 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.344160 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.359745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 268/536] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:45.364819 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.365845 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.373196 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:45.374760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:45.496282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 269/537] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:45.571066 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2683d-ce9f-4f52-a873-7cc564adbe88 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.627366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.628529 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.629035 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.629436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.650758 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.654284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-2ce2e9a1-a153-4d1a-9b58-641c7f648bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:45.682495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:45.683463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:45.684480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:45.684480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:45.684480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:45.685879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 269/538] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:45.694371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.732333 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973837d-3043-45b9-a2a5-0fde68a30860 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.732734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973837d-3043-45b9-a2a5-0fde68a30860 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.733077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973837d-3043-45b9-a2a5-0fde68a30860 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.735142 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 270/539] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:45.741911 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.742222 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.742539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.764893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:45.766588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:45.775921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.841827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4589ef1-d340-47f6-91ac-bb977fa981ec None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.860733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 271/540] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:45.866012 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.898934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.899645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.899900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.900126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.900885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:45.901186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.903265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.906280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.916904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 270/541] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:45.925413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.001439 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c77a0-768e-42ac-b49c-a6b6d554f1e0 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.040401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.041432 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.041981 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.042442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.054958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:46.060638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.061541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:46.062319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:46.065196 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 272/542] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.066115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffe74-35da-4973-abe5-f35d4f60b899 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.075525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.076762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.107699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.108596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.109019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.109429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.119176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.122659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:46.140280 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.142707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:46.143644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 271/543] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.148294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.224653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.256985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9ba10-3891-4fcc-8be5-cc7d5704efdb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.287775 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7741-4411-4209-b600-09c629e766a1 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.301610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.302239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.302516 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.302787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.303474 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:46.304077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.305894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.323849 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 273/544] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:46.325976 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.337009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.337631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.337905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.338168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.338891 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:46.339188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.340828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.363830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 272/545] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:46.365337 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.428128 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.483685 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23a94-ba5c-418b-9fbd-206e60edf4d8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.505391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cb0ae-9c6f-4f47-8706-0e74ef710f4b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.522945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.528187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.529394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.529939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.530408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.546796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:46.547184 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.547875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.548155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.548422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:46.554574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.555533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:46.556319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:46.557904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 274/546] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.559250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.564171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.565691 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:46.585077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.592290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:46.593220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:46.593220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.593220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:46.593220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 273/547] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.593220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.724819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaacc0-4350-4076-b98c-9545e128719a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.726171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614a2d7-0779-4d8f-b407-4e2a90accda8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.757380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.772497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.773040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.773312 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.773578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.778651 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.778784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:46.778784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.778959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.778959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.778959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.779232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.789696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 274/548] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:46.789696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.792571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.794214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:46.818458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.820181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:46.821494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:46.821494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.821494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:46.821494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 275/549] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:46.821494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.832477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.915418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d4e4-45a2-4cf3-9da2-257f372a97b5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.936857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c057c6-1687-4295-82c4-18174894d31c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.951424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.952080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.952452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.952653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.953287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:46.953588 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.954948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.966435 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 275/550] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:46.967279 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.974456 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.975181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.975459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.975755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.987219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.988726 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-665b5047-6b5e-4e3b-b5ed-760482f89708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:47.003332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.004375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:47.005814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:47.005814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:47.005814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:47.005814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 276/551] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.006051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34c1c-3cea-409f-b64a-ea69c46093b7 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.006232 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34c1c-3cea-409f-b64a-ea69c46093b7 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.006445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34c1c-3cea-409f-b64a-ea69c46093b7 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.007928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 277/552] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:47.008496 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34c1c-3cea-409f-b64a-ea69c46093b7 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.041377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.075814 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.089028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35f34d-6d92-4e2d-a91e-74458f683e96 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.124638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34c1c-3cea-409f-b64a-ea69c46093b7 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.126254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.126907 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.127205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.127468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.128275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.128581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.130409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.143348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 276/553] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.144231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.170990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.171572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.171849 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.172120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.179533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.180997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-1c5b928c-cb4a-47aa-b959-0b6ef1863789 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:47.194112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.195402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 278/554] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.196594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.197378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.197378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.215832 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:47.217175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:47.255935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc24a13-4dbf-486c-9490-4691673db836 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.290934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 279/555] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:47.291823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.304647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.305295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.305524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.305772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.306410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.306791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.308156 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.312985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.325902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 277/556] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.325902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.337809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.415073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a59e-ef13-4467-8d40-101d02ba7115 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.441190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1b301-b573-4237-b2c4-0247ca50fe3c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.455255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.456212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.456490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.456753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.464711 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.467143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:47.488563 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.492443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 280/557] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.493618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.497593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.498233 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.498511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.498784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.499636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.500046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.501542 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.526909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 278/558] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.526909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.612140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.615318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.642025 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a601ba6-83a5-417c-a80b-1d52532d4b59 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.659710 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87a455-7f5b-401c-86f6-2187c0c0ceef None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.683680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.684391 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.684666 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.684945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.692818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.694188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.696815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.697501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.697786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.698057 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.698822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.699126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.701276 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:47.707933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.709063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:47.710024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 281/559] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.710828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.716147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 279/560] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.716952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.820502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983d66-4385-4986-a826-7bbbade0b052 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.823289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc5ca-26c6-43d8-8ee5-3b832aa3cfcc None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.851043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.855274 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.856080 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.856429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.856762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.859571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.863585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.863585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.863585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.865118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:47.869135 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.870587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.871000 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:47.875862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.876902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:47.877861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 280/561] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.878703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:47.887576 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:47.888761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:47.889764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:47.889764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:47.889764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:47.889764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 282/562] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:47.889764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.985680 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259317-32c4-4b14-a123-511bc53e3c5b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.992819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e55-4f91-44bb-b61b-4efc2e3eab61 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.021816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.022422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.022694 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.022960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.023742 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.024044 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.025511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.028181 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.028912 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.029187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.029450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/64a888930adc468c9fbeaa51913de637/roles/f884d219ca994b198732bc1a7e26dfcf` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.045210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=64a888930adc468c9fbeaa51913de637, role_id=f884d219ca994b198732bc1a7e26dfcf)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.046225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 281/563] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.046660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.047070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.092316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.117119 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 283/564] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:47 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/64a888930adc468c9fbeaa51913de637/roles/f884d219ca994b198732bc1a7e26dfcf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:48.118038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.165645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634816-e808-4434-ad3e-ed74e0c643eb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.178794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.206006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.206694 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.207033 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.207314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.208511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.208511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.209772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.224255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 282/565] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.225186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.260015 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a717960-80d6-4cdb-a5e6-f59b575952d9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.307856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.309041 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.309041 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.309234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.310189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.310756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.312170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.324852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 284/566] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.325618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.359467 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698be47-64c0-411c-a078-c4a9089c9e93 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.368332 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.398217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.398867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.399240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.399520 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.412062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.414059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:48.430278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:48.431321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:48.432667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:48.432667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:48.432667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:48.432667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 283/567] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:48.432667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.454094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.457188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab54df-2885-4704-866f-6e7619f8e296 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.498734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.499540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.499942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.500334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.513453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.515429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:48.536807 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:48.538006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:48.539093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:48.539093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:48.539093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:48.546341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 285/568] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:48.546341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.557296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bf29d-239d-4284-8eb2-ee954449fe98 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.603048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.603048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.603048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.603048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.616963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.620815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:48.634805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:48.636042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 284/569] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:48.642468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.666735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.684921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2235-062b-4c5c-8e70-f7d6f9ccd34a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.726351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.727323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.727629 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.727942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.728580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.728878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.730301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.748403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 286/570] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.748403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.761060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.773904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a3a1a-9fe9-43c5-aa1c-29191ae1f80b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.810345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.811119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.815837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.815837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.815837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.815837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.815837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.833089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 285/571] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.833089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.852463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae85-a1d7-41d1-8bed-7c056ebaeb10 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.893859 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.894433 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.894714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.894986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:48.895727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:48.896039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:48.897499 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:48.911587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 287/572] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:48.912414 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:48.927837 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.953752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911912d-2ff8-48a1-aa89-adabfc442a9f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:48.988274 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:48.997195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:48.997876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:48.998482 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:48.998754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.007890 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.009659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:49.024465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:49.033577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 286/573] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:49.035316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.038850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33fb54-da0d-434b-8229-8fcd514cc3d0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.071038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.072039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.072313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.072582 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.081212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.089721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:49.099476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:49.100490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 288/574] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:49.101684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.157674 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e331d-4b43-41f8-aaaf-6cff53258e06 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.204483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.205141 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.205427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.205699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/3b13ed7288ab43e08f7b842927e77d6b/roles/f884d219ca994b198732bc1a7e26dfcf` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.216565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.224289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=3b13ed7288ab43e08f7b842927e77d6b, role_id=f884d219ca994b198732bc1a7e26dfcf)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.225975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.230018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f707fd-beb5-4646-b17b-23ea5174bfa2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.259929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.265374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.265983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.266258 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.266527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.267219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.267555 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.268998 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.282006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 289/575] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.282800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.323526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 287/576] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:49 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/3b13ed7288ab43e08f7b842927e77d6b/roles/f884d219ca994b198732bc1a7e26dfcf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:49.323526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.419026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f70b-5127-4d4c-9c31-23f866235959 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.466452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.467964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.468250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.468522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.469300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.469743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.471393 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.482683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa7ce9-ae82-47ee-91de-a34b48642e3d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.497559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 290/577] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.503642 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.563829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.564856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.565148 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.565427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/6f428da0321f49fa81fa70bcdddeaf3e/roles/f884d219ca994b198732bc1a7e26dfcf` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.572639 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.585067 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=6f428da0321f49fa81fa70bcdddeaf3e, role_id=f884d219ca994b198732bc1a7e26dfcf)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.586950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.647494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e550d-a2b2-43b1-8fa2-0990ad84adb1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.689163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.689803 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.690067 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.690408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.707547 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 288/578] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:49 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/6f428da0321f49fa81fa70bcdddeaf3e/roles/f884d219ca994b198732bc1a7e26dfcf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:49.713030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.714713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:49.733127 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:49.734195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:49.735072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:49.735072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:49.735072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:49.735072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 291/579] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:49.741664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:49.792643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.867170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08000bf-796e-425b-a5e1-68a47e983e58 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:49.909114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:49.909730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.910005 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.910273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.910986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:49.911285 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:49.912702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:49.927115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 289/580] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.932746 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.051164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc6f3-878c-45f5-951a-8b97dee6c347 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.052877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.090808 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.091694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.092209 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.092492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.100823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.102329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:50.116167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:50.117245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:50.118143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 292/581] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:50.123934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.233339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.240231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b928d9c-2074-44f7-8555-3ee222f2ff2e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.284199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.284833 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.285109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.285421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.286140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:50.286595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.287966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339deaa-03ec-45fa-8315-899202a3e6fb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.302852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 290/582] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:50.308814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.435462 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53297-fcbc-4fc7-8827-1fd16afcf06a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.464643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037619-f954-497a-8ff3-0a20b1e48f68 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.464921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037619-f954-497a-8ff3-0a20b1e48f68 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.465762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037619-f954-497a-8ff3-0a20b1e48f68 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.467119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 291/583] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:50.473644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.473959 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.474199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.484006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.484708 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.484989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.485260 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/b7eebced2e1c452abe1bd93520f0f6d8/roles/f884d219ca994b198732bc1a7e26dfcf` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.495858 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:50.498120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:50.505909 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=b7eebced2e1c452abe1bd93520f0f6d8, role_id=f884d219ca994b198732bc1a7e26dfcf)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.507977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.596143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 292/584] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:50.619521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 293/585] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:50 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/b7eebced2e1c452abe1bd93520f0f6d8/roles/f884d219ca994b198732bc1a7e26dfcf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:50.954125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.070120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.083862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084050-a95a-43d9-acb1-9ec8594651e3 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.126442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.127217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.127376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.127645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.140043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:51.144935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:51.146910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:51.148586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 293/586] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:51.154155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.172147 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.282512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d107ec-c0c4-456d-9e2d-2521faa3ff3b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.330735 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.331805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.332206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.332552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.333287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:51.333793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.336224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.347623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 294/587] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:51.357611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.489781 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc37a-359c-49be-9861-e38629f004fd None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.538311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.538881 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.539163 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.539437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.557080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.559898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.571800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-3019ed17-1262-4d17-ae66-2d4385db1a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:51.584129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:51.586396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:51.588842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:51.588842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:51.588842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:51.588842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 294/588] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:51.591387 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.694981 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.738022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4fc3-9a01-40b8-a9d2-feaa365cf6bd None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.738507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4fc3-9a01-40b8-a9d2-feaa365cf6bd None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.741187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a4fc3-9a01-40b8-a9d2-feaa365cf6bd None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.741697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 295/589] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:51.751257 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ca5e-3214-4940-8883-f7917c6743ba None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.752369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ca5e-3214-4940-8883-f7917c6743ba None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.752849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ca5e-3214-4940-8883-f7917c6743ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.765268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64110f-cc53-4398-a477-afb9a9a9dcb4 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.785107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-3f41ca5e-3214-4940-8883-f7917c6743ba None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:51.787714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-3f41ca5e-3214-4940-8883-f7917c6743ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:51.843076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.844503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.845211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.845660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.847079 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:51.848168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.851151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.879617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 295/590] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:51.882151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.933395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 296/591] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:12:52.082362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725fab-996d-4f3e-b845-f734698f45f0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.151736 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.153403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.154178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.155030 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.158904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.170895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.174376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c1c0-0ee7-4cff-9de0-f1a1fa1c4b86 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.174376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c1c0-0ee7-4cff-9de0-f1a1fa1c4b86 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.174376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c1c0-0ee7-4cff-9de0-f1a1fa1c4b86 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.175382 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.175883 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 297/592] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:52.186248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.187222 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.188038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:52.202868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:52.204919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:52.207036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 296/593] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:52.217154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.229763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:52.233165 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:52.392171 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 298/594] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:52.404822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82805f1-9c7f-4b3d-9c77-607ac2f69799 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.472037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.474293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.474865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.475217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.476012 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:52.476321 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.477773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.509503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 297/595] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:52.520253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.544767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.646440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.675625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.737618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd3a63-b798-4d2e-8a28-9d0b69e2dcc6 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.759848 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f1387-e64f-49ef-afad-381bd4f263e9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.799984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.801522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.802328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.803074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.843036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.844153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.844653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.845397 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.870255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:52.880281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:52.881761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:52.883039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:52.892440 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 298/596] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:52.896493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.961546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.964935 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.079186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.081610 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacf4ae-5430-455b-825d-ceefbf339013 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.144773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 299/597] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:53.148455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.285420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.330409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.331453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.331992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.332491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.333721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.334236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.336850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.366351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 299/598] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:53.366351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.392618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a74f1-7370-4070-9ddc-f9d4b624c414 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.494324 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.494977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.495270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.495593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.510579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:53.516617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:53.518495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 300/599] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:53.520394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.566267 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.599104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db037ce3-cf5a-47a7-bcbb-d919bb618ac9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.682615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.683368 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.683696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.684823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.697511 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.699156 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:53.716717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:53.718632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:53.720512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:53.720512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:53.720512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:53.720512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 300/600] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:53.720512 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.722098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955f5c-5045-456e-ab76-18c6669f3713 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.766542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.794124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.795447 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.796031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.796491 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.816998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.819898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-b79e99de-5149-4b58-91b8-b09a2c12a3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:53.849774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:53.850845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:53.851926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:53.851926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:53.851926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:53.851926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 301/601] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:53.854240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54958-2466-4e07-ac98-dd6f5e670f33 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.854240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54958-2466-4e07-ac98-dd6f5e670f33 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.854622 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54958-2466-4e07-ac98-dd6f5e670f33 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.857834 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 302/602] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:53.859587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54958-2466-4e07-ac98-dd6f5e670f33 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.872472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff963-65e7-453b-90fe-4440b9171ae3 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.932926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.933944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.934484 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.934943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.936165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.936702 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.939441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.956304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 301/603] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:53.957750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.995822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.052773 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54958-2466-4e07-ac98-dd6f5e670f33 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.098742 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.099385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.099792 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.100165 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.100901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.101287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.102767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1e9e-7eb9-4f42-9a31-f7d98dc84e12 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.119339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 303/604] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.120653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.120929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.121193 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.141201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:54.142542 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:54.157321 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.174946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89c29-c388-46a2-94d0-da40fc0cb9d9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.223557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 304/605] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:54.224539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.240335 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.241258 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.241816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.242174 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.243289 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.243727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.245507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.272494 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 302/606] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.273568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.311522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.369358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51267dd-ef52-4f3c-bc9a-01e00d779e2e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.420192 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.421157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.421293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.421650 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.422217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69186665-278d-401b-86ba-5df1e135a573 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.444130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.445627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:54.468001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:54.469700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:54.472124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:54.472124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:54.472124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:54.472124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 305/607] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:54.472124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.500410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.501300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.501765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.502225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.516840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.519320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:54.533939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:54.534925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:54.535858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 303/608] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:54.536333 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.551326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.643142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f16a8-c89b-4101-9ff2-f62e1a496d1c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.671339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.685476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97643d-43f3-40ea-8443-c9f19f819741 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.701072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.701871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.702471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.702829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.713134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.716396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.727944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.728561 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.728856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.729113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.729732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.730024 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.732091 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:54.735211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:54.736253 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 306/609] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:54.737198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.751791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 304/610] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.752969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.870018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d80e7c-182c-44cc-908d-67ddb4e41194 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.870711 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.908956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.909458 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.909738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.910031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.910733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.911034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.912521 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:54.924857 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97690a2d-dfe0-4dd9-a634-82dd33a24c6c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:54.930870 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 307/611] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:54.932083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:54.975575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:54.982429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:54.983409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:54.983895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:54.984339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:54.985591 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:54.985996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:54.988484 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.019747 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 305/612] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.028991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.075735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36f5fa-3fc5-4442-b5d4-58c94f87f953 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.118847 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.119507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.119789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.120061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.128205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.129744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:55.143688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:55.145919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 308/613] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:55.147918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.172224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807a13-1516-49c0-8657-aff7b3468aed None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.207644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.219207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.219888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.220432 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.220690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.237162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:55.242013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:55.244131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 306/614] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:55.245847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.274036 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.281875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c25d7f-bb0b-4510-b97b-30431313536c None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.322915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.323541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.323816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.324083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.325380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=64a888930adc468c9fbeaa51913de637) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:55.325678 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.327196 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.334027 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 309/615] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/role_assignments?user.id=64a888930adc468c9fbeaa51913de637&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.334860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.381664 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a75-6bda-47b8-a725-931cf28c7afe None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.425704 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.426212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.426485 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.426757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.514522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.517226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1cd3-0df5-4454-a986-0823b88eda76 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.534184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.535715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.575574 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.577531 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.578221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.578444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.579801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:55.580323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.582978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.612014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 310/616] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.612014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.647741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.676650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 307/617] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:55.677453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.811114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcac03b-bdf6-4910-986a-39b9623ae40f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.831245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:55.860751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169bbc-9906-468f-8b32-50adbeb583b8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:55.880149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.881342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.882249 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.882855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:55.883882 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:55.884883 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:55.888577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:55.907523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 311/618] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:55.909028 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:55.922806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:55.922806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:55.922806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:55.922806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.064874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.087823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.090623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.115914 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d332b-6c96-4a0a-8a62-69519cbe2640 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.174236 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.175123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.175890 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.176134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.190895 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.192809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:56.228389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:56.229514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:56.230593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:56.230593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.230593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:56.230593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 312/619] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:56.230821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.244816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.282288 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 308/620] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:56.283098 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.406243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed021f-4bd2-491c-b136-201db37d1026 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.448012 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e915a6-1d10-4cf9-8af9-eb3811d9c866 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.448291 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.460098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.460851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.461152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.461541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.482667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.484448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:56.502199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:56.503827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:56.504733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:56.504733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.504733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:56.504733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 313/621] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:56.504733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.514381 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.515413 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.516158 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.517588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.517747 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:56.519161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.520706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.538029 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 309/622] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:56.539377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.621305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.690635 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784f762-2654-4dbf-83f2-b6c1e39c134f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.695692 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17e21-a373-49a2-8c28-412eadc95ce2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.738046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.738832 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.739208 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.739451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.750280 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.750920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.751248 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.751606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.752558 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:56.752984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.753578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.754674 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.755042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.775323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 310/623] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:56.777510 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:56.779404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:56.781876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:56.784164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:56.784164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:56.784164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:56.784164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 314/624] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:56.785940 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.837485 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.927203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79efa4-fc96-49f8-b7e0-5649d764a274 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.927769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6426e-08e4-4162-a063-25299897b4ec None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.942190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.965064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.966276 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.966689 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.967150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.977706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.980409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.989307 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.989945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.990219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.990489 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.998890 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:56.999456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.001342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:12:57.002915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:57.003985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.004118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 315/625] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:57.004118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:57.019920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.021534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 311/626] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:57.022447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.146230 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f885-6dff-4020-9b4b-f39d09920ffc None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.148579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.158175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e659f6-a8fe-44b9-9215-fa72b053b058 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.201052 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.201931 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.202398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.202845 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.204568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.205072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.207598 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.210524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.211360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.211681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.211951 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.212616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.212909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.216828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.239181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 316/627] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.241220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.250253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 312/628] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.250505 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.298327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.468141 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b113a-9cc8-4cab-8ca5-2353ad695ac2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.479232 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24c23e-a295-4aaa-9eda-19b34bf9ed08 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.522840 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.523720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.524162 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.524620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.525529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.526018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.527839 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.535150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.535875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.536188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.536493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.552102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 317/629] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.552102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.554760 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.556038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:57.570430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.572103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 313/630] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:57.573671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.581847 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.759081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.773724 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9aab0-dc0f-4b07-aaf3-79d478aed4a7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.791213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5ca4-7bd5-41d7-b69e-2fce15e4260d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.833964 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.834962 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.834962 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.835243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.854881 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.856056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.856442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.856944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.858380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=3b13ed7288ab43e08f7b842927e77d6b) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.858900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.861681 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.875412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 314/631] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/role_assignments?user.id=3b13ed7288ab43e08f7b842927e77d6b&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.875412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.942258 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.944386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.971745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.064251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68012427-ad20-4b53-bb22-263f70f1261d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.121972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.122987 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.123308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.123606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.124337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.124652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.126146 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.133031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 318/632] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:12:58.140525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.151706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 315/633] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:58.161839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.183313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.329781 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1323f5-61d3-4947-bc7f-facde098209f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.331527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f4b7-ad3d-410c-bb2d-bcf537cd6be0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.360206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.399536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.400367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.400898 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.401251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.402236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=6f428da0321f49fa81fa70bcdddeaf3e) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.402691 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.404136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.404836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9970d-dfcf-456c-8a4e-53784a308131 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.405204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.405670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.406143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.419757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 316/634] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/role_assignments?user.id=6f428da0321f49fa81fa70bcdddeaf3e&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:58.419757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020334d-44c6-431c-99b5-308fac8e14e5 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.419757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020334d-44c6-431c-99b5-308fac8e14e5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.419757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020334d-44c6-431c-99b5-308fac8e14e5 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.419757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 317/635] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:12:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:58.428784 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.429093 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.429520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.430054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.431738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.460863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:58.461573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:58.463739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:58.466080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:58.466080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:58.466080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:58.466080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 319/636] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:58.466588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:58.471192 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.620169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 318/637] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:12:58.687539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06081202-13df-492e-964b-ecc79d1610c5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.767769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.768755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.769228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.769665 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.770757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.771322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.773828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.797841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 320/638] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:58.806619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.811780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.005345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4647da8-d766-4c20-815e-fcc2e3f80b9f None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.082694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.083873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.084234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.084712 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.102765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.103453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:59.128603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:59.130338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:59.132073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 319/639] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:59.136977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.176342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.219402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.273437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2c00-11ff-4e35-9650-65b31c24dea3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.316409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.317025 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.317309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.317554 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.318247 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.318538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.320303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.336768 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 321/640] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.345077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.349388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.435956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43630bc9-0656-467d-a60c-2db31c1d1ff2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.497254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.505172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.506788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.507246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.508046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.521343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17370b-fec3-40d2-9480-5963fb0bb14a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.525577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:59.533528 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:59.534667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:59.536657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:12:59.537667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 320/641] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:59.545480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.574949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.575808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.575905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.576182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.576861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=b7eebced2e1c452abe1bd93520f0f6d8) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.577199 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.578759 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.592767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 322/642] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/role_assignments?user.id=b7eebced2e1c452abe1bd93520f0f6d8&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.713250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794ce3-a5fa-4732-ac36-2fe979c10979 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.744454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.759270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.760326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.760815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.761382 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.763023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.764385 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.766249 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.777521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 321/643] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:59.785778 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.909770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2d34-628c-4d40-88f1-51a0ebc1ad10 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.951822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.953046 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.953541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.954044 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.967643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.969738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:59.987909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:59.988924 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:59.989855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:59.989855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:59.989855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:12:59.991816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 323/644] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:59.998658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.123243 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f455371-3759-4a3c-b31c-e1182c3e38af None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.164850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.165892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.166401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.166892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.167854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:00.168372 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.170628 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.185116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 322/645] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:00.193772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.196917 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.328579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fe328-dcac-4732-945b-f5ac3be36d50 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.371172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.373483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.373982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.374463 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.384104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.386270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:00.399996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:00.401009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:00.401973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:00.404961 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 324/646] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:00.412420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.477942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.578694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a877e98-df94-4303-b2a3-dd684081d04b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.662616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.662616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.662616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.662616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.663215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:00.663215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.667531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:00.705886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 323/647] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:00.714387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:00.787615 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:00.833190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311460-f903-4bf9-a7d0-624bc947e3b9 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:00.874186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:00.874812 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:00.875087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:00.875358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:00.957129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:00.958740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.033748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.083704 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 325/648] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:13:01.093842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.305573 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89175907-e89e-47c8-8d3c-7b81a52df5e2 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.308156 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.371212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.372953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.373743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.374478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.394565 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.397788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-dfdb5ca3-c85c-4742-a063-37ec1c68ff27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:01.426680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:01.428498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:01.430246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:01.430246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:01.430246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:01.439617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 324/649] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:01.442721 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.651543 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f140a8-5f12-4f20-9e88-fbf0b033fe7d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.677480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ec9-1065-477f-9a8f-1545fc82d35b None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.677973 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ec9-1065-477f-9a8f-1545fc82d35b None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.678436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3546ec9-1065-477f-9a8f-1545fc82d35b None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.687991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 325/650] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:01.690282 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee4c8-8888-4703-be9e-d476b42fd2c8 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.690773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee4c8-8888-4703-be9e-d476b42fd2c8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.691255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee4c8-8888-4703-be9e-d476b42fd2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.722926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.723584 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.723874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.724144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.724808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:01.725110 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:01.726538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:01.728695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-da0ee4c8-8888-4703-be9e-d476b42fd2c8 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:01.731955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-da0ee4c8-8888-4703-be9e-d476b42fd2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:01.741832 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 326/651] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:01.751947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.785106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:01.877309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 326/652] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:01.878953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1278-e757-4f7a-bf00-4b4617c9f76f None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.879238 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1278-e757-4f7a-bf00-4b4617c9f76f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.879701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1278-e757-4f7a-bf00-4b4617c9f76f None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.885226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 327/653] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:01.889828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.890102 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.890251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.903098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061659-43e0-44cf-a5e7-43f9a1eafb61 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.911748 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:01.912980 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:01.998413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:01.999129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.999410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.999716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.015521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 328/654] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:02.015828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.017475 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:02.031302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.033143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:02.034934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 327/655] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:02.045411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.066128 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.170125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50199109-b682-46a9-8215-4ac1108e3313 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.212601 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.213227 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.213511 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.213781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.214565 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.214875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.216947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.232255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 329/656] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:02.242427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.407001 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.438613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935bc4-a932-415c-a232-49e6c6608d06 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.491224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.492433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.492902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.493367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.494758 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=64a888930adc468c9fbeaa51913de637) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.495282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.499359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.500774 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.512012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 328/657] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/role_assignments?user.id=64a888930adc468c9fbeaa51913de637&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:02.581453 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.631954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.674650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b346097-05df-4364-857e-20d32d6210e7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.725290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.726607 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.727114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.727645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] PATH_INFO: `/v3/services/image` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.728470 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.730996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.741180 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7dbc-b11b-435b-a46e-1875e0c8cf19 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.751694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.752794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:02.753713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:02.762547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 330/658] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/services/image => generated 86 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:02.770406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.799102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.800155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.800637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.800961 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.801820 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.803852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-98a2c56e-451e-48b9-9355-7711814214ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.819410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.820647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:02.821535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 329/659] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:02.823056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb61f-6590-4a9e-a544-a9c349b90050 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.823056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb61f-6590-4a9e-a544-a9c349b90050 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.823056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdb61f-6590-4a9e-a544-a9c349b90050 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.824504 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 330/660] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:02.833736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.834107 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.834290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.869263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:02.871408 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:02.877350 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.941071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a11e9b-48df-4f4c-895b-62df98f40a87 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.003966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 331/661] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:03.006385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.023535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.025373 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.025754 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.026233 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.028700 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] RBAC: Adding query filter params (name=image) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.029618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.032111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.041378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 331/662] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:03.050688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.056575 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.243546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a5a99-19c5-400a-9c41-095df34b4135 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.268243 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08becd-59bd-4113-aaca-355252c67d3e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.316938 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.317563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.318415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.318713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.319350 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.319963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.321413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.333218 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 332/663] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:03.343055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.346862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.347927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.348406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.348947 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.350076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] RBAC: Adding query filter params (type=image) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.350602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.353234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.368931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.371694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 332/664] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:03.380343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.471334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.546344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b29ac-dd1c-43db-abb7-c9e0bd4f5a2d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.559371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb0aa1-b88c-4602-b1f6-8ebb8706fa36 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.605580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.606842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.607937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.608368 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] PATH_INFO: `/v3/services/network` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.609105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.610595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.617932 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.618550 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.618828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.619087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.619759 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.620051 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.621475 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:03.624816 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:03.626793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:03.629297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 333/665] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:03.639535 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.639847 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 333/666] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:03.779359 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e224e-9907-4dc4-9d3e-bcf58f34537a None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.814278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.820859 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.821508 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.821800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.822051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.822715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] RBAC: Adding query filter params (name=network) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.823023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.824598 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c805f3-5263-4cbe-a2d2-63268474d3bc None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.830910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 334/667] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:03.837035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:04.049893 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:04.089802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c73e-51c2-4d6b-a205-6ebcd4b5fb91 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:04.129418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:04.130174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.135228 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.135558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.136657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] RBAC: Adding query filter params (type=network) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:04.137063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:04.139119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acf775-ad7a-4b07-9359-c95d9934bbbe None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:04.146229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 334/668] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:05.194737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0e67-0c8c-4a70-8b45-b929bd005cd4 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.195354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0e67-0c8c-4a70-8b45-b929bd005cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.195712 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab0e67-0c8c-4a70-8b45-b929bd005cd4 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.198167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 335/669] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:05.204412 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.205422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.205896 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.227229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:05.229300 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:05.369359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 335/670] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:05.702789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab0e67-0c8c-4a70-8b45-b929bd005cd4 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.830891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab0e67-0c8c-4a70-8b45-b929bd005cd4 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:05.872745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:05.873559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:05.873841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:05.874113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:05.886862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:05.892589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:05.893978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:05.895375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 336/671] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:05.902749 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:05.980599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.023839 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e568678-25be-4981-a7a5-1f109be72279 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.084525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.085612 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.086102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.086590 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.087880 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:06.088427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.091336 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.110410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 336/672] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:06.117179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.241809 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.333063 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0521cd-6f2e-4eb5-921e-1233b39acb0b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.402847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.404099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.404549 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.404987 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.426900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.429687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:06.459820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:06.460894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:06.461800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:06.461800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:06.461800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:06.462515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 337/673] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:06.469570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.595947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f17d2d-3df6-4a32-9eb7-b170c96fc9c6 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.625331 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.638612 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.643844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5847a9-d12f-4a2a-a9ec-876bd5c10490 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.656913 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 337/674] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:06.665747 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:06.711533 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e82a4-2bb6-40fa-b654-6314ebc70a06 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.711894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e82a4-2bb6-40fa-b654-6314ebc70a06 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.712087 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e82a4-2bb6-40fa-b654-6314ebc70a06 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.713888 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 338/675] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:06.720091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.720417 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.720903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.741238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:06.742462 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:06.850646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41358dc3-1421-4bb3-81c7-fbb826f71953 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:06.862009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 339/676] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:06.863808 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.917546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:06.919459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.920265 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.921016 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.936534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:06.939574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:06.971473 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:06.973099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:06.974752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:06.979479 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 338/677] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:06.988117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.108170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775838-03ab-4c22-8f49-0855ec612fc9 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.124746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.163822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.164566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.165201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.165958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.166733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.167038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.169761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d3270-d208-4ffe-83cd-59d2e9022846 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.193032 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 340/678] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:07.203348 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.263085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169ae6-cfd1-4790-b69b-b7fffb4ccf47 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.263826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169ae6-cfd1-4790-b69b-b7fffb4ccf47 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.264465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169ae6-cfd1-4790-b69b-b7fffb4ccf47 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.267571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 341/679] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:07.274130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.274826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.275513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.307179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:07.309408 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:07.376051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c6cf8-611f-4c58-aefc-19ef46c9396f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.419378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 342/680] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:13:07.421367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.443959 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.445115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.445628 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.446409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.469432 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.472539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-99548951-ccab-476c-a949-668211e3a7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:07.495815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:07.497806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 339/681] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b576c-a275-40be-be6d-b3d4ccd75d25 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b576c-a275-40be-be6d-b3d4ccd75d25 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.499621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b576c-a275-40be-be6d-b3d4ccd75d25 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.504891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 340/682] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:07.506245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.506539 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.506798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.527365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:07.529278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:07.554792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.580319 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9a40-9506-40fd-a089-ce64644ed516 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.583859 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.647085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.648783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.649674 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.650678 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.652077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.655547 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.655942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 341/683] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:13:07.657124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.770616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 343/684] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/services => generated 251 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:07.869527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19037-59a0-436c-bb07-8722c5f2aec2 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.874539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.934590 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.935296 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.935612 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.935882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.936552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.936855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.938271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.955220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 342/685] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:07.964154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.983594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.073558 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f32b81-5f11-4e54-86cf-21f0153be261 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:08.118174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:08.119121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.119392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.119681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.120360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:08.121751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:08.137182 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dc905-2fa9-4f04-bfec-5266fc05218c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:08.180554 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 344/686] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:07 2022] POST /identity/v3/services => generated 242 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:08.181806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:08.197314 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:08.198922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.201143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.201921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.218613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:08.222522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:08.238660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:08.248891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:08.259076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:08.260893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 343/687] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:08.264771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:08.401882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.419395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189891d-98ab-4b96-aac1-84d2de81f9bb None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:08.474145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44db4f-39ba-4f42-a054-7941cb8bd104 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:08.479289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:08.480311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.480794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.481264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.482660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:08.484834 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fa8a4-7644-42a6-be41-c726e3e1f017 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:08.535961 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:08.537032 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.537502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.537960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.539159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:08.539687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:08.542329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:08.566636 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 344/688] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:08.575905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:08.576999 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 345/689] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:08 2022] POST /identity/v3/services => generated 240 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:08.736277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91f76c-ca60-43d5-b14b-5eae4eb6ccc8 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:08.764143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.786965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:08.787684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.787957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.788225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/64a888930adc468c9fbeaa51913de637/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.790344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=64a888930adc468c9fbeaa51913de637, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:08.791871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20deb-0698-462b-a731-5f6e5fe51a66 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:08.867917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 345/690] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:13:08 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/64a888930adc468c9fbeaa51913de637/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:11.242419 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c641-fb69-43f3-8269-f5f5b2b18447 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.243215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c641-fb69-43f3-8269-f5f5b2b18447 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.243215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c641-fb69-43f3-8269-f5f5b2b18447 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.244643 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 346/691] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:11.255097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bfcd-601a-4924-8790-116961bd9c77 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.255885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bfcd-601a-4924-8790-116961bd9c77 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.255885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07bfcd-601a-4924-8790-116961bd9c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.282605 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-9c07bfcd-601a-4924-8790-116961bd9c77 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:11.283860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-9c07bfcd-601a-4924-8790-116961bd9c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:11.330521 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7dd7-2448-4d32-b03c-6b68f1c8760e None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.331452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7dd7-2448-4d32-b03c-6b68f1c8760e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.332279 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7dd7-2448-4d32-b03c-6b68f1c8760e None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.335467 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 347/692] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:11.350929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d207-de0e-4cc1-8479-44ab76a81a45 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.352101 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d207-de0e-4cc1-8479-44ab76a81a45 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.352909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376d207-de0e-4cc1-8479-44ab76a81a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.389535 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5376d207-de0e-4cc1-8479-44ab76a81a45 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:11.392806 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5376d207-de0e-4cc1-8479-44ab76a81a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:11.543660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 346/694] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:11.545432 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 348/694] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:11.716344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38e4-d68a-41d5-98da-ba8451dc5f52 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.717425 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38e4-d68a-41d5-98da-ba8451dc5f52 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.718188 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d38e4-d68a-41d5-98da-ba8451dc5f52 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.721699 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 347/695] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:11.730213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.730654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.731132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.764686 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:11.766700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:11.783114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:11.898316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 349/696] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:12.048994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d38e4-d68a-41d5-98da-ba8451dc5f52 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.179784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.189497 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d38e4-d68a-41d5-98da-ba8451dc5f52 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.214116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.255417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.257587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.258045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.258459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.259270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.261360 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.277772 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.279967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:12.281239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:12.291187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 348/697] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.293804 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.374306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493e039-01ec-4881-8fc4-351b3b41c019 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.419601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.420374 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.420835 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.421130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.421753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.423430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.434449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.440088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.440958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 350/698] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.441793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.453039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.478097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaf6be-2c08-47c2-841a-686c0fd7f6b5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.524085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.524800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.525073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.525334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.526033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] RBAC: Adding query filter params (name=image) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.526336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.527893 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.534255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 349/699] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.537168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.596418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.608716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf29929-2a88-42f5-9044-0befbf7e2f8f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.668490 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.671106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.671106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.671106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] PATH_INFO: `/v3/services/network` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.671106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.672557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:12.691250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:12.692541 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:12.693399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 351/700] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:12.695845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.721090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a74925-83b5-4bda-9f73-b30c53f7a969 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.788057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.789113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.789593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.790045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.791108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.791644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.794303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.798307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:12.810815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 350/701] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.810815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.846590 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c1fe0-12be-469b-9e28-28410edec188 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.886390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.887026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.887297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.887598 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.888390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] RBAC: Adding query filter params (type=image) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:12.888684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.890597 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34950845-926f-47f5-ae55-55e1e16c906c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.895751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 352/702] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:12.896998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a2a9d-1f49-4a08-afa0-3b047a6e1763 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.897275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a2a9d-1f49-4a08-afa0-3b047a6e1763 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.897544 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a2a9d-1f49-4a08-afa0-3b047a6e1763 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.899663 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 353/703] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:12.901786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a2a9d-1f49-4a08-afa0-3b047a6e1763 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.017449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.031917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b793-1f86-44a7-bd6d-3cfe6d0feda9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.038173 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a2a9d-1f49-4a08-afa0-3b047a6e1763 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.096315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.097198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.097647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.098079 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.099179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] RBAC: Adding query filter params (name=network) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.099712 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.100278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.100900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.101180 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.101450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.101941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd432d-2440-41b5-ba1d-9bdd87ce0ffa None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.102085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.102376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.103817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.106386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.110466 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 354/704] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.111025 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 351/705] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.111393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.117983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960be54-7789-4f16-8503-498b7447146e None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.117983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960be54-7789-4f16-8503-498b7447146e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.117983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960be54-7789-4f16-8503-498b7447146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.149139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-7960be54-7789-4f16-8503-498b7447146e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:13.151087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-7960be54-7789-4f16-8503-498b7447146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:13.258963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20287a3-7f1a-4695-a88b-d420204af01f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.273533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 352/706] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:13.274811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960be54-7789-4f16-8503-498b7447146e None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.317352 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.318045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.318323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.318592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.319356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] RBAC: Adding query filter params (interface=public, service_id=1e31279e39be4aa8afb443d0a80aee1a, region_id=RegionOne) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.319892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.322263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.336989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 355/707] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/endpoints?service_id=1e31279e39be4aa8afb443d0a80aee1a&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.338444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.443593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.455543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.465048 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960be54-7789-4f16-8503-498b7447146e None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.506076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] RBAC: Adding query filter params (type=network) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.510172 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.520522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 353/708] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.520522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.526513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796e73-3b15-485d-b34b-c7304453afa0 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.579292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.580066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.580339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.580607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.581307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] RBAC: Adding query filter params (interface=public, service_id=296bba98c55848118d11e044bfcd4186, region_id=RegionOne) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.581611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.583008 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.594862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 356/709] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/endpoints?service_id=296bba98c55848118d11e044bfcd4186&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.596273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.696503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69c257-a42e-459f-a58f-2838eeb0c748 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.720750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aec3c6-97b2-47e9-93a4-c447e769ac17 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.754303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.754928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.755221 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.755520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.756804 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.758680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.765301 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.767732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 354/710] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services => generated 1002 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:13.769246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.789452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.789979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.790259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.790534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.791275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] RBAC: Adding query filter params (interface=public, service_id=523e22c46f2e405cae8bdfdadb3640e3, region_id=RegionOne) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.791626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.793194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.803540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 357/711] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/endpoints?service_id=523e22c46f2e405cae8bdfdadb3640e3&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.803540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.822764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.956968 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c1ff4-35b1-4e40-83c1-b1c2a0423969 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.968278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f72c16-9ad2-4a81-ae6e-a12feac89b03 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.016254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.017343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.017793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.019374 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.037096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.038096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.038552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.038919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:14.039092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.040161 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.042570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:14.051727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:14.053655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 358/712] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:14.056898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.059873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 355/713] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services => generated 1002 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:14.061617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.160918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.229922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.266761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33385675-a19a-4d72-ae7e-68cf3a213798 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.270430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e79689-ff30-43b7-ba8e-038e924bac62 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.335678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.336405 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.336545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.336824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.337819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.337819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.339246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.344512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.344776 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.345195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.345607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.346804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.350868 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.353945 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 356/714] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.360795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.366155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 359/715] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/services => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:14.579046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59648bb-25e1-400f-add8-6b14cc5f20f1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.630559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.631690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.632179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.632872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.649104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.650925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.668196 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:14.682013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:14.683134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:14.693917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:14.693917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:14.693917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:14.693917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 357/716] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:14.694152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.810494 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18302e52-3db2-494e-80eb-16b15ec652d7 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.827040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:14.850379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.851007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.851295 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.851600 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.852263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:14.852567 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.854050 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.871749 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 360/717] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:14.875722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.023293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0bebe-4cb6-4c0d-b0df-63817671bdfa None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.076534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.077263 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.077537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.077814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.086727 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.088219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:15.102293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:15.104291 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:15.106153 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 358/718] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:15.111725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.274794 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad7bd1-3e10-482f-8af4-1245c5e48e46 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.333700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.334846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.335322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.335816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.337109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:15.337570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.339655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.369782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 361/719] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:15.381267 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.512064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.586465 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3894ad-8dd7-463f-b2aa-01e105162fe4 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.666572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.667287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.667818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.668313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.757173 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.758678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:15.843608 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:15.890747 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 359/720] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:13:15.899358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.955791 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.040396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af79362-633a-4202-81a0-cc39b009f812 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.085081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.086052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.086501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.086918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.101380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.103218 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:16.121577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:16.123090 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:16.124166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:16.124166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:16.124166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:16.126116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 362/721] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:16.131951 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.288058 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2602924-1a13-45c0-9c8f-fe58838cff9f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.331042 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.331713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.331994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.332266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.332934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:16.333239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.334650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.349530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 360/722] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:16.355018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.464486 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.484608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515af493-95a9-4b76-8e8f-3defc5a66ad8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.524585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.525619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.526095 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.526572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.536347 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.538177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:16.559205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:16.560746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:16.561801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:16.564432 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 363/723] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:16.570968 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.602580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.728658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00954fbd-420a-405e-b359-e9d4c429ee94 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.774160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.774788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.775068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.775339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.776086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:16.776390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.777839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f865d8c-8cec-4828-8033-c08846445e5b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.792853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 361/724] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:16.801226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.978380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece494-686e-4f7f-bf8d-282b77d8c6df None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.979037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece494-686e-4f7f-bf8d-282b77d8c6df None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.979553 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adece494-686e-4f7f-bf8d-282b77d8c6df None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.984146 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 362/725] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:16.987929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ceb3-4896-4cd5-bbcf-0a947094ef22 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.990034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f4f8-83f3-41fd-bc20-fe1bc66fa319 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.990609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f4f8-83f3-41fd-bc20-fe1bc66fa319 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.991193 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f4f8-83f3-41fd-bc20-fe1bc66fa319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.015803 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-9719f4f8-83f3-41fd-bc20-fe1bc66fa319 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:17.017683 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-9719f4f8-83f3-41fd-bc20-fe1bc66fa319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:17.064436 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.065478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.065960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.066529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.068123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=64a888930adc468c9fbeaa51913de637) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:17.068676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.071652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86938b2f-65fe-4b27-ac3d-ed81017c2ca7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.084692 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 364/726] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/role_assignments?user.id=64a888930adc468c9fbeaa51913de637&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:17.127675 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 363/727] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:16 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:17.299944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4a5f-b6d0-426c-b51c-318f22464b5d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.300359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4a5f-b6d0-426c-b51c-318f22464b5d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.300855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4a5f-b6d0-426c-b51c-318f22464b5d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.303458 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 365/728] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:17.313754 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.314294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.314799 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.344183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:17.346953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:17.351068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.369206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf74-88b2-473c-a785-c570d64b83de None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.369671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf74-88b2-473c-a785-c570d64b83de None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.370060 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dadf74-88b2-473c-a785-c570d64b83de None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.373479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 366/729] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:17.379992 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.380470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.380750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.418890 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:17.421738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:17.425928 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:17.511256 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 364/730] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:17.570638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 367/731] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:17.595474 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.813852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ffdf4-2b99-4028-aa02-238fe4842067 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.869320 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.883587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.884394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.884738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.885075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] PATH_INFO: `/v3/services/image` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.885792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.887445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:17.898523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:17.899647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:17.901039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 365/732] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/services/image => generated 86 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:17.909484 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.915130 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.022072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5719d-4fa7-4849-8a67-795b2a64607b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.069996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.070753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.071098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.071385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] PATH_INFO: `/v3/services/network` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.072188 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.073712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.084985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.092140 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.094729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 368/733] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:18.100422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.101489 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.180252 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c602dd0-3686-49b9-883f-b26a3567ba80 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.230908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.232017 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.232456 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.232903 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.234003 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] RBAC: Adding query filter params (name=image) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.234482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.237688 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.251521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 366/734] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.258806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.277636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaeaaa2-68eb-491b-a81e-93ade4ec7ff3 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.325048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.326217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.326497 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.326873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.327542 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] RBAC: Adding query filter params (name=network) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.327842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.329306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.336399 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 369/735] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.346405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.392645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.459416 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fffab9-3948-4e80-b48e-140e6570c815 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.475340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.525170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10425c-d49a-4fac-8b91-b75185676014 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.529476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.530910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.531411 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.531921 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.533026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] RBAC: Adding query filter params (type=image) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.533533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.535999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.550800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 367/736] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.550800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.585739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.586637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.587029 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.587390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.588217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.591269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:18.605495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:18.608738 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:18.610457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 370/737] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:18.613096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.766557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f12928-9441-4fa2-9ac5-31b0d6038441 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.787961 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32d9a-c43b-4337-a1f4-b17422fea95a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.809300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.816481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.817320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.817604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.817878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.818547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] RBAC: Adding query filter params (type=network) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:18.818850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.820369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.835410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 368/738] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:18.835410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.854605 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:18.866693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.867825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.868311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.868788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.870016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.873356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.000611 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac3997-5f5a-440f-b799-67c717908cc7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.047636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 371/739] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:19.047636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.078842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.079922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.080375 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.080824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.081877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:19.082633 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.085104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.101522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 369/740] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:19.105104 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.231568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.306182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f3c04-74af-4fae-9f09-9b13b140e5cf None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.346572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c805-cc9c-4cb4-870b-a317085ab725 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.387167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.388843 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.389227 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.389684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.390902 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.393519 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9a3c2-7de3-4521-ae9d-b55ed4d3541d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.421337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.422178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.422720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.423159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.424201 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:19.424687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.426235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.432665 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 370/741] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:19.442359 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.537491 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 372/742] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:19.590171 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f4279-7959-4f7b-a901-516c6ac6dc01 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.615070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:19.644796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b340f-486f-4094-b94d-641450794320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.645430 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b340f-486f-4094-b94d-641450794320 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.645704 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b340f-486f-4094-b94d-641450794320 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.645969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b340f-486f-4094-b94d-641450794320 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.646640 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b340f-486f-4094-b94d-641450794320 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.648119 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b340f-486f-4094-b94d-641450794320 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.759472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 371/743] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:19.794373 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171471f2-e287-4a03-8298-c41e95f9368f None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.795152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171471f2-e287-4a03-8298-c41e95f9368f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.795439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171471f2-e287-4a03-8298-c41e95f9368f None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.796994 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 373/744] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:19.803450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.804240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.804240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.831789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:19.833546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:19.965301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 372/745] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:20.308010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171471f2-e287-4a03-8298-c41e95f9368f None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.370111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.486217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171471f2-e287-4a03-8298-c41e95f9368f None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.554543 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.555964 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.556630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.557442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.558699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.562234 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:20.578202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:20.580003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:20.581647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 374/746] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:20.589121 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.787064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:20.800145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103d9d-39d6-4a3a-bb34-3e81ff5721dd None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.872890 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.873953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.874432 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.874923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.875805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:20.876358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.878667 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd558-f576-4973-a773-aaa2aa29064f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.889558 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 373/747] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:20.899103 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:21.040076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df64aa-2317-498c-8594-a76f9fca7353 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:21.049508 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:21.085960 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:21.086979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.087289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.087576 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.088292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:21.088870 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:21.090489 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd20545-6846-4405-9022-77de21903bf7 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:21.097950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 375/748] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:21.968951 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dcf31-a41e-4606-be48-6d5e716afce6 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.969779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dcf31-a41e-4606-be48-6d5e716afce6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.969779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dcf31-a41e-4606-be48-6d5e716afce6 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:21.972362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 374/749] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:21.978631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a250-b26a-48b0-aeaf-2059bc548953 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:21.979397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a250-b26a-48b0-aeaf-2059bc548953 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:21.979779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872a250-b26a-48b0-aeaf-2059bc548953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.001487 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-1872a250-b26a-48b0-aeaf-2059bc548953 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:22.002871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-1872a250-b26a-48b0-aeaf-2059bc548953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:22.085044 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 376/750] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:21 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:22.433951 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dcf31-a41e-4606-be48-6d5e716afce6 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.519289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e12b-4228-41f4-b200-028bc7c4add5 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.519702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e12b-4228-41f4-b200-028bc7c4add5 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.519901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e12b-4228-41f4-b200-028bc7c4add5 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.521429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 377/751] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:22.527105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.527582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.527720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.549187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:22.550477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:22.571169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dcf31-a41e-4606-be48-6d5e716afce6 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.626481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.627111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.627632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.627791 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.642371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 378/752] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:22 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:22.670592 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:22.731386 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.732920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.884928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 375/753] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:13:22.894030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.937265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.002716 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.044097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e3777-6bcb-49bf-b9c6-2e2f428ba888 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.098878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.114655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.116110 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.116621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.117111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.136642 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.140065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.158574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed5db-b91e-4664-8644-26b695927144 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:23.165912 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:23.168369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:23.174746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:23.174746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:23.174746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:23.174746 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 379/754] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:23.179223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.208569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.209598 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.209744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.209990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.210607 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.212086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:23.223509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:23.224811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:23.225672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 376/755] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:23.234972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.320716 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.349200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb03e4-fe05-466d-a987-162d8fb01583 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.399127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.399774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.400076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.400339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.400993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.401300 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.402802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.416163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eab8a-d49d-45ae-b1e2-5cb66c097bc1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.419053 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 380/756] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:23.477874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:23.493852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.494711 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.495159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.495594 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.496542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.496951 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.499978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0d3a3-2012-4c1d-87a7-401601062ab7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.507367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 377/757] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:23.515526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:23.698310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6279d0c-98c6-4a99-95f4-c5ead98f0da5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:23.760826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:23.762024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:23.762544 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:23.763043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:23.764907 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:23.765465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:23.768309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083fd2e-58ca-45a2-8866-b6da279fc43f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:23.777953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 381/758] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:24.192151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935302-100a-4a73-ac1a-0cfc1b9c2ea8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.192990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935302-100a-4a73-ac1a-0cfc1b9c2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.193143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3935302-100a-4a73-ac1a-0cfc1b9c2ea8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.196137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 378/759] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:24.202286 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4827341-7f9e-4e1a-b6b3-f549f437a873 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.202814 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4827341-7f9e-4e1a-b6b3-f549f437a873 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.202814 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4827341-7f9e-4e1a-b6b3-f549f437a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.221739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:24.228435 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-e4827341-7f9e-4e1a-b6b3-f549f437a873 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:24.229936 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e4827341-7f9e-4e1a-b6b3-f549f437a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:24.352512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 382/760] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:24 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:24.712834 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935302-100a-4a73-ac1a-0cfc1b9c2ea8 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:24.901585 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3935302-100a-4a73-ac1a-0cfc1b9c2ea8 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:24.947846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:24.948374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:24.948653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:24.948926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:24.949574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:24.951843 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c0169-7a54-494e-9979-7f2a379b5f5e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.055296 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 379/761] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:24 2022] POST /identity/v3/services => generated 269 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:26.282461 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22741ee-d8a7-4385-919b-0e5d7e9e9c1f None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.283223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22741ee-d8a7-4385-919b-0e5d7e9e9c1f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.283223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22741ee-d8a7-4385-919b-0e5d7e9e9c1f None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.284394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 383/762] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:26.290508 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b3a5-e50a-45b0-a9ea-eb0103008941 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:26.291319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b3a5-e50a-45b0-a9ea-eb0103008941 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:26.291319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b3a5-e50a-45b0-a9ea-eb0103008941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:26.318093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-b1c8b3a5-e50a-45b0-a9ea-eb0103008941 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:26.320617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-b1c8b3a5-e50a-45b0-a9ea-eb0103008941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:26.401335 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:26.459965 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 380/763] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:26 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:26.976305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22741ee-d8a7-4385-919b-0e5d7e9e9c1f None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:27.137264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22741ee-d8a7-4385-919b-0e5d7e9e9c1f None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:27.181123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:27.181820 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.182152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.182493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.183203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:27.184965 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cba017-bbcf-47e1-87dc-c09b1c773b7f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:27.190168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:27.265878 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 384/764] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:26 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:27.732695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c7d92-01db-4f7a-9bd0-a4bde5aeab4a None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.733518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c7d92-01db-4f7a-9bd0-a4bde5aeab4a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.733676 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c7d92-01db-4f7a-9bd0-a4bde5aeab4a None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.735579 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 381/765] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:27.741854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:27.742369 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:27.742640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:27.762650 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:27.764786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:27.856291 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 385/766] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:27 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:28.237402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c7d92-01db-4f7a-9bd0-a4bde5aeab4a None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.432963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c7d92-01db-4f7a-9bd0-a4bde5aeab4a None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.486635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.487294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.487680 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.487903 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.488492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.489926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:28.500883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:28.504046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:28.504960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 382/767] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:28.512100 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.667913 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7e3-f850-4810-82f5-bbd8b36d1373 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.698448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.716421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.718523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.718901 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.719293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.720216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:28.720711 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.722759 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.728847 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 386/768] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:28.735992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.812319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:28.925592 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62def14-1df0-4950-8ea5-8ed88bcf6dcc None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.989835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.990906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.991402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.992007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.993199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:28.993758 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.996752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.008498 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 383/769] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:29.018538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.166439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2b5c6-0e69-4d45-8143-2c3f8fdd77b8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.212685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.213397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.213725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.214048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.214881 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] RBAC: Adding query filter params (interface=public, service_id=86ef832b6fc04036a68a921bcf9261d3, region_id=RegionOne) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:29.215238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.217132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b87186-4be4-459c-bfc6-14765678e102 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.224248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 387/770] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/endpoints?service_id=86ef832b6fc04036a68a921bcf9261d3&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:29.235213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:29.378986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631c96-76b8-4ee7-83c8-73c728a372c7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:29.380902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:29.426917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:29.427536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.427924 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.428292 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.429090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:29.430540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4dee-2b6a-480e-ace7-6936687db8ea None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:29.439250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 384/771] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:29 2022] GET /identity/v3/services => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:29.858327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bf5d4-9066-4150-9918-0c6920f481e7 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.858632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bf5d4-9066-4150-9918-0c6920f481e7 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.858911 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bf5d4-9066-4150-9918-0c6920f481e7 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.860673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 388/772] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:29.868205 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:29.868862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:29.868977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:29.893900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:29.895162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:29.984692 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 385/773] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:30.478313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bf5d4-9066-4150-9918-0c6920f481e7 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.537557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.597981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bf5d4-9066-4150-9918-0c6920f481e7 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.640675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.641756 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.642386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.642679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.643736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.645881 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:30.656420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:30.658782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:30.668885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 389/774] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:30.671604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.782926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:30.789643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1142d-743f-4560-a0f2-057433c734f5 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:30.835810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:30.836438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.836722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.836996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.837694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:30.837969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:30.839417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:30.853166 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 386/775] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:30.854201 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:30.993487 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54773b-4c32-4a25-bb3c-407f1524ccb0 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.009557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:31.033468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.034013 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.034289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.034624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.035294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:31.035636 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.037081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.043181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 390/776] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:31.051257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.185637 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c287b1-04a9-4ad5-bc31-18d558b92a1c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.224670 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.225286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.225566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.225835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.226540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] RBAC: Adding query filter params (interface=public, service_id=eceaa087b2e445b79494f3723833a581, region_id=RegionOne) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:31.226843 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.228296 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40528eb3-6f5e-4dbb-bc5e-7621ccc99acb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.236966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 387/777] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/endpoints?service_id=eceaa087b2e445b79494f3723833a581&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:31.245430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.366130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc6f09-b99e-4b8a-98b5-070af5280529 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.411190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.411864 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.412144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.412414 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.413042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.414473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e086e-c115-46b3-8394-b8c73bcd6274 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.422281 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 391/778] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/services => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:32.196517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845d7-e36c-4543-9794-eeb6d11663ca None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.197330 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845d7-e36c-4543-9794-eeb6d11663ca None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.197487 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d845d7-e36c-4543-9794-eeb6d11663ca None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.199028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 388/779] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:32.206076 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.206731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.206731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.227974 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:32.229217 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:32.271927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:32.319413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 392/780] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:32 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:32.658545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d845d7-e36c-4543-9794-eeb6d11663ca None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.688240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:32.781999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d845d7-e36c-4543-9794-eeb6d11663ca None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:32.833681 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:32.834339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:32.834616 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:32.834886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:32.835476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:32.836868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:32.846347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:32.848255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:32.849310 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 389/781] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:32.854348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:32.970672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa6dd-9956-4642-9a41-104977974186 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.009478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.010099 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.010371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.010634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.011267 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:33.011626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.012997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.019139 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 393/782] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:33.025487 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.184340 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.199987 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de589c9-39dc-429a-a9ff-7382d5bc7049 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.241253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.241906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.242355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.242806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.243583 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:33.243960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.245490 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c71b5-64b2-458e-b2da-0cee414f90b3 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.252304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 390/783] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Aug 23 22:13:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:33.258926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:33.308540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:33.398548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dc0ff-0f1c-4d6c-ba61-dc4344104f14 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:33.440339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:33.441010 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:33.441289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:33.441565 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:33.442243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:33.443700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84768a27-0af1-4205-8a36-cabdc7e3bc0f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:33.578660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 394/784] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:35.070920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a00e-8803-4709-9dba-2637caccf83c None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.071520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a00e-8803-4709-9dba-2637caccf83c None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.071613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a00e-8803-4709-9dba-2637caccf83c None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.073340 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 391/785] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:35.080276 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.081142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.081308 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.106452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:35.108017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:35.220003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 395/786] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:35 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:35.688187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a00e-8803-4709-9dba-2637caccf83c None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.856721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a00e-8803-4709-9dba-2637caccf83c None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:35.923675 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:35.924529 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:35.924919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:35.925330 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:35.926086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:35.927860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:35.941647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:35.945443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:35.947913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 392/787] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:35.961027 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:35.994105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.164400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1fb03-f738-4ce2-acb9-e0be443dc52b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.240706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.241672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.242174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.242663 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.243819 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:36.244341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.247007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.257701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 396/788] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:36.263917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.287918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.391952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eecb78-7f9e-4800-95ed-adae6632e0f9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.433905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.434517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.434800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.435066 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.436468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:36.436836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.438653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a57e5-533c-4a1f-bcf5-5f7acba178f1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.444614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 393/789] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Aug 23 22:13:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:36.451040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:36.573442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.596655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e19c1-46cc-440c-b1cc-9d73b20d55e2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:36.645147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:36.645804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.646078 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.646348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.647030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:36.648479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:36.673747 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d11-ba39-4d6f-ac38-0444624a1914 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.674023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d11-ba39-4d6f-ac38-0444624a1914 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.683658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb45d11-ba39-4d6f-ac38-0444624a1914 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.683658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 394/790] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:36.685788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.686055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.686334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.707178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:36.708451 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:36.743599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 397/791] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:36.824131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 395/792] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:37.172152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.298430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6db34-b4f3-474a-82a9-1f52f936bd70 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.338557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.339209 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.339518 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.339790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.340380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.341804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:37.354673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:37.356515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:37.357539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 398/793] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:37.362906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.372891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.490410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9388-af49-459a-8960-203ad9fc99f2 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.541149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.542184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.542726 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.543183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.544374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:37.544845 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.548177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915d7f-ff59-45a8-abac-f7df456b78c4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.564920 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 396/794] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:37.566175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.570022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.735313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e7b03-23d8-430b-ab3c-a8786e1e1610 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.778856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.780302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.780302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.780673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.781438 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:37.781842 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.783334 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f45be-9d9f-4a6e-b312-20f3efa5d00c None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.788826 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 399/795] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:39.389422 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01144-0599-44ae-b3be-b3d3241f383b None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.389997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01144-0599-44ae-b3be-b3d3241f383b None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.390397 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01144-0599-44ae-b3be-b3d3241f383b None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.392941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 397/796] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:39.401395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.402178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.402466 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.424470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:39.425700 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:39.508785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.517634 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 400/797] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:39.866548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01144-0599-44ae-b3be-b3d3241f383b None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.950318 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:39.988813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01144-0599-44ae-b3be-b3d3241f383b None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.028904 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.029913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.030195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.030468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.031110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.032595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.035252 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING keystone.server.flask.common [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 22:13:40.095925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.sql.core [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:13:40.095925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:13:40.095925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [parameters: {'id': '55ff4fb89dc84966bcd76d503ea4d2dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:13:40.095925 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88942) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ff4fb89dc84966bcd76d503ea4d2dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ff4fb89dc84966bcd76d503ea4d2dc. Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:40.113988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 22:13:40.117327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application yield resource Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise self.value Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application session.commit() Aug 23 22:13:40.119363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:13:40.121584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:13:40.124344 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:40.126534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [parameters: {'id': '55ff4fb89dc84966bcd76d503ea4d2dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.128929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:40.131038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ff4fb89dc84966bcd76d503ea4d2dc. Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:40.134164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 398/798] 10.222.0.50 () {60 vars in 1140 bytes} [Tue Aug 23 22:13:39 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:40.140910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.254007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f5a49-2e1e-4691-a430-2465a2ddfd81 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.293231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.293889 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.294169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.294442 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.302827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.304360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-951a7470-1845-4184-9c84-ebeb78d34357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:40.317910 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:40.319690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:40.321548 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 401/799] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:40.327129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:40.444931 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b34540-e992-48d0-9b71-b5a16f730ae6 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:40.474472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:40.483961 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:40.512618 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dd36c-3067-4937-ac1a-8f75214c463a None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:40.513241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 399/800] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:40.605283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872f-e4b2-491f-b286-97fc739f3ddc None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.606116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872f-e4b2-491f-b286-97fc739f3ddc None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.606116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872f-e4b2-491f-b286-97fc739f3ddc None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.608328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 402/801] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:40.615406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824fea-9c5b-45f1-8ae7-df58cd3f94f3 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:40.615900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824fea-9c5b-45f1-8ae7-df58cd3f94f3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:40.616321 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824fea-9c5b-45f1-8ae7-df58cd3f94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:40.638542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-51824fea-9c5b-45f1-8ae7-df58cd3f94f3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:40.640764 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-51824fea-9c5b-45f1-8ae7-df58cd3f94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:40.734149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 400/802] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:41.081242 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d872f-e4b2-491f-b286-97fc739f3ddc None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:41.153056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:41.215351 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d872f-e4b2-491f-b286-97fc739f3ddc None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:41.272623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:41.273608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:41.274072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:41.274526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:41.275736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:41.278343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93210b8-e95e-4835-be06-04eaf29d5cef None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:41.370409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 403/803] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:41 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:13:43.839721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb9b75-5c12-4872-8edf-38b8db523cac None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.840532 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb9b75-5c12-4872-8edf-38b8db523cac None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.840734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb9b75-5c12-4872-8edf-38b8db523cac None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.842914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 401/804] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:43.853213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae404-6f92-4bbc-975e-024fcf71a46e None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:43.853764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae404-6f92-4bbc-975e-024fcf71a46e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:43.854176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae404-6f92-4bbc-975e-024fcf71a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:43.884990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-b41ae404-6f92-4bbc-975e-024fcf71a46e None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:43.887034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-b41ae404-6f92-4bbc-975e-024fcf71a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:43.984157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 404/805] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:43 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:44.333115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb9b75-5c12-4872-8edf-38b8db523cac None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:44.511463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb9b75-5c12-4872-8edf-38b8db523cac None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:44.533524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:44.562351 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:44.563392 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.563928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.564404 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.565542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:44.568306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:44.620770 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41145-31df-4652-90f9-3edfd8d75cb5 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.621012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41145-31df-4652-90f9-3edfd8d75cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.621314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a41145-31df-4652-90f9-3edfd8d75cb5 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.622747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 405/806] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:44.629153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.629433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.629708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.640538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.sql.core [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:13:44.640538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:13:44.640538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [parameters: {'user_id': 'ab710b13d57a463eb012e8bba7a8e137', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:13:44.640538 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88942) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:13:44.649319 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:44.650534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:44.651819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:44.652833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application yield resource Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise self.value Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application session.commit() Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:13:44.653781 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:13:44.654757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:13:44.656105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application result.read() Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:13:44.657134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ab710b13d57a463eb012e8bba7a8e137', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:44.658350 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 22:13:44.659327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 402/807] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Aug 23 22:13:44 2022] POST /identity/v3/users => generated 160 bytes in 327 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:44.671866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:44.694750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:44.732224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 406/808] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:44 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:44.800759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f507802-77b7-41e7-8268-0d19ab9647e9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:44.843380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:44.844192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.844544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.844883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.858621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:44.860720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:44.875884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:44.877964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:13:44.879861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:44.883699 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 403/809] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:44.885169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.004097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f557eb-d507-4e98-a97a-9d79b1515fc5 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.046474 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.048143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.048143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.048446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.049243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.049645 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.051202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.081992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.091007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 407/810] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Aug 23 22:13:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:45.135650 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.233870 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e08dc-78cc-4b45-a262-0ff121d156fb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.295954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.297010 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.297357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.297720 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.298396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.300453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:45.310596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:45.313305 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:13:45.314814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 404/811] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:45.321120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.366563 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.464058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f41aa-0ddf-48b3-83df-852c61df1f41 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.505093 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.505713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.505985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.506251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.506897 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.507189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.508605 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.514173 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 408/812] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:45.523935 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.670634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40051f8-d502-4ce5-a9d6-b0cf50388c81 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.672789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.713238 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.714269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.714706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.715186 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.716386 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.716927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.721120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.737801 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 405/813] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:45.744653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.862335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:45.870401 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e967df-7416-42c5-9f71-4034cbe953b8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.919183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.920845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.921340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.921829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.923132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] RBAC: Adding query filter params (interface=public, service_id=94ac45074bd341c29e7c3dde7b8c30cb, region_id=RegionOne) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:45.923705 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.926286 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d2e3c-af47-429b-bd44-b04646d789fd None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.935745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 409/814] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/endpoints?service_id=94ac45074bd341c29e7c3dde7b8c30cb&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:45.942355 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:46.063149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8d79-67fc-41e2-8817-afff31e6c681 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:46.103379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:46.105356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:46.105356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:46.105356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:46.105356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:46.106745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bc203-7d73-4d7d-9f91-215d0f00e040 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:46.115094 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 406/815] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/services => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:13:48.464551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531571f7-9fa7-4dbf-8cc4-412575166734 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.465169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531571f7-9fa7-4dbf-8cc4-412575166734 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.465488 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531571f7-9fa7-4dbf-8cc4-412575166734 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.468557 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 410/816] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:48.475195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:48.475819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:48.476159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:48.496833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:48.498366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:48.528417 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:48.579546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 407/817] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:48 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:13:49.199204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531571f7-9fa7-4dbf-8cc4-412575166734 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.311626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531571f7-9fa7-4dbf-8cc4-412575166734 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.350185 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.351167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.351525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.351860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] PATH_INFO: `/v3/services/compute` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.352501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.354655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:49.367540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:49.368725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:13:49.370342 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 411/818] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:49.376394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.494997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fc1f4-7a4e-40e4-a0e7-2f257c46c9ce None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.530776 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.531646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.531926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.532220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.533150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:49.533396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.534800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.540358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 408/819] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:49.546827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.576261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:49.665685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a2e5-3d56-4414-8bfc-949ce75a8a0a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.705859 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.706465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.706740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.707006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.707679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:49.708102 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.709752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61236c7-e4dd-4518-a64d-8b7893177a94 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:49.715586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 412/820] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Aug 23 22:13:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:49.726371 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:49.774202 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:49.860336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8d44-8552-4970-90d4-0773443fc45d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:49.901483 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:49.902496 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:49.902979 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:49.903458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:49.904682 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:49.907268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980909c-fc8c-4167-ae24-30df9a90f015 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:50.020990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 409/821] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:59.712667 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=57 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:00.016220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:20.985289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1fca2-74f5-4fac-b10b-b92514d9b6b5 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.985841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1fca2-74f5-4fac-b10b-b92514d9b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.985841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1fca2-74f5-4fac-b10b-b92514d9b6b5 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.987068 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 413/822] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:20.993595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.994974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.994974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.014997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:21.016239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:21.095319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 410/823] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:21.431405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1fca2-74f5-4fac-b10b-b92514d9b6b5 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.543304 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1fca2-74f5-4fac-b10b-b92514d9b6b5 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.583378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.584040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.584345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.584613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.595852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.597502 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:21.615397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:21.618987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:21.620108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:21.620108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:21.620108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:21.620108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 414/824] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:15:21.623420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.748197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b095-f531-44c7-b155-42d7799fd3f1 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.778049 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:21.788287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.788908 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.789185 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.789453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.790101 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:21.790519 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.792611 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788dba-7f96-45df-b339-e02bf44e96a5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:21.804874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 411/825] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:21.811998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:21.874898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:21.943203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224abae5-28d3-4b1b-9fdf-3fd0ae38ee37 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:21.980154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:21.980761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:21.981035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:21.981303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:21.981944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:21.983394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b9acb-4578-4438-abd1-6a652d048124 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:22.089948 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 415/826] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Aug 23 22:15:21 2022] POST /identity/v3/users => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:24.495740 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4641-8659-420d-a6c8-9aac1a6926f9 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.496377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4641-8659-420d-a6c8-9aac1a6926f9 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.496377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e4641-8659-420d-a6c8-9aac1a6926f9 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.497603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 412/827] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:24.502966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.503757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.503757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.523096 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:24.524354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:24.593282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 416/828] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:24.922946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e4641-8659-420d-a6c8-9aac1a6926f9 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.032120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e4641-8659-420d-a6c8-9aac1a6926f9 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.068287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.068986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.069261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.069525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.082728 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:25.088076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:25.089306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:25.090159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 413/829] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:25.097725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.140035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.207750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bef249-73c2-4efc-b7f6-e9be156a53f7 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.244589 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.245194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.245468 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.245736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.246386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:25.246681 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.248150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.257764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 417/830] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:25.263824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.313010 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.371341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84395b0-76d1-4bfa-973a-2a1572c65d2e None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.411285 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.411956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.412239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.412513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.424491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.426393 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:25.441788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:25.442914 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:25.443900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:25.443900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:25.443900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:25.443900 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 414/831] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:25.449178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.554766 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.557735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a492c-23fc-4ed5-86ea-a155fd1dd9cf None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.595495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.596296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.596582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.597747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.598366 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:25.598754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.600183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.615297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 418/832] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:25.621247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.726566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:25.730820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05371c0-b723-4718-bfd1-5ccc161127ed None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.767183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.767854 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.768134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.768460 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.776428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.777863 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:25.789999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:25.792828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:25.794031 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 415/833] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:25.797873 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:25.910427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1728-1843-4a3f-9cfe-06bb22d89b86 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:25.948148 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:25.948761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:25.949035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:25.949297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:25.950043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:25.950338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:25.951800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:25.971158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 419/834] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:25.977327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:26.102771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b91c-9b53-42cb-b686-e7d2d8d440cb None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:26.138967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:26.139619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:26.139901 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:26.140175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:26.169630 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:26.212223 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:26.213708 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:26.320261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 416/835] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:25 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:26.326984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:26.347788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:26.436765 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793ea76-4936-4403-8512-4126c2980ec6 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:26.481519 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:26.482172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:26.482446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:26.482725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:26.495544 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:26.500366 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:26.514403 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:26.515979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:26.517041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:26.517041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:26.517041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:26.517041 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 420/836] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:26.523050 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:26.594849 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:26.650525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84116562-fde2-44b4-aa18-7e6949a105ba None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:26.687362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:26.688023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:26.688303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:26.688571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:26.689213 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:26.689579 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:26.691593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:26.704491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 417/837] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:26.711149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:26.786765 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:26.822988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c79c-d469-40d6-8128-c94f1476078d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:26.859503 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:26.860232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:26.860545 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:26.860850 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:26.868730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:26.870319 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:26.884747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:26.885970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:26.887238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 421/838] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:26.892377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:27.005377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26c856-a895-4374-beea-00c049c6d08d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:27.023604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:27.041052 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:27.041654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:27.041929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:27.042196 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:27.042883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:27.043184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:27.044646 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998bd8-6fa4-4c81-8fec-4d8d06fad802 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:27.057721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 418/839] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:27.063939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:27.173464 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f152a8-12ed-4209-b6e1-2deb908da953 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:27.205519 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:27.212410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:27.213197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:27.213481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:27.213848 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:27.214575 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=1aec380fe79b477e907cc777efab1018) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:27.214875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:27.216538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f6b9-bc61-4291-89dc-5a2acd3bfda6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:27.222359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 422/840] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:27 2022] GET /identity/v3/role_assignments?user.id=1aec380fe79b477e907cc777efab1018&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:29.564088 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574b1fa-0d61-4563-8f30-f6df7a636556 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:29.564696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574b1fa-0d61-4563-8f30-f6df7a636556 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:29.564696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574b1fa-0d61-4563-8f30-f6df7a636556 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:29.566836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 419/841] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:29.572655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:29.573222 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:29.573222 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:29.594179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:29.595526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:29.671453 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 423/842] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:30.004741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574b1fa-0d61-4563-8f30-f6df7a636556 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.121998 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574b1fa-0d61-4563-8f30-f6df7a636556 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.163542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.164187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.164463 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.164734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.175203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:30.179957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:30.181060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:30.181960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 420/843] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:30.188900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.296261 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570bf32-e631-46b8-abd2-252ab613f2d8 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.322167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.334824 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.335444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.335979 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.336080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.336673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:30.336970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:30.338344 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:30.347318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 424/844] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:30.353142 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.397009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.457557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771b24-86d6-42c0-b221-b171283640f5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.493220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.493882 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.494163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.494429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.505357 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:30.506795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:30.521169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:30.522364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:30.523518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:30.523518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:30.523518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:30.523518 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 421/845] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:30.528197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.634075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8df6f-0b25-4cbc-8925-1f36def5c9c8 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.670855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.671464 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.674179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.674179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.674179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:30.674179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:30.674480 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:30.686610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 425/846] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:30.692712 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.788297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.797540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51dd41-1a39-4fdc-a26a-8948bff10624 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.833169 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.833813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.834086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.834322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.841504 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:30.842922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:30.855366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:30.857827 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:30.858780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 422/847] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:30.862454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.915187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.969903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200a83-7228-45a8-8383-d7a953559a8e None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.005779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.006387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.006761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.007040 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.007851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:31.008156 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.009617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.028394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 426/848] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:31.034227 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.146599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943e785-e7d9-4386-83b8-6e18ff448606 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.181658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.182193 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.182470 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.182742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.194255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.197152 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:31.211057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:31.212308 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:31.213464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:31.213464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:31.213464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:31.213464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 423/849] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:31.217971 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.331456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9cc39-12c8-4f2d-a993-4d1220263970 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.333886 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:31.368530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.369245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.369675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.369950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.370593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:31.370895 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.372299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.384389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 427/850] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:31.390251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.393898 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:31.498533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83edbf-fece-4429-9b66-f76252dc5283 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.535775 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.536767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.537053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.537325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.544442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.547401 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:31.557975 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:31.559155 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:31.560313 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 424/851] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:31.565235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.676278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e74c-ca3f-4e08-abbb-7c372533acd5 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.711522 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.717769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad5175-2856-414c-997c-7d6bfdaf4344 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.727398 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 428/852] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:31.733969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:31.800541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:31.841004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57d203-3351-474a-9740-fd1e8d7fd405 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:31.875092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:31.875780 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:31.876106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:31.876345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/1aec380fe79b477e907cc777efab1018/roles/f884d219ca994b198732bc1a7e26dfcf` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:31.891441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=1aec380fe79b477e907cc777efab1018, role_id=f884d219ca994b198732bc1a7e26dfcf)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:31.892917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8f099-9d3d-44b6-a9ce-3dd1c196b6dc None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:31.965420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 425/853] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:15:31 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/1aec380fe79b477e907cc777efab1018/roles/f884d219ca994b198732bc1a7e26dfcf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:34.173418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2aefa-2844-4b4b-8ac0-99a34671fa51 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.173998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2aefa-2844-4b4b-8ac0-99a34671fa51 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.173998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2aefa-2844-4b4b-8ac0-99a34671fa51 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.175258 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 429/854] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:34.181493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.181928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.182014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.201367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:34.202560 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:34.270493 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 426/855] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:34.600067 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2aefa-2844-4b4b-8ac0-99a34671fa51 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:34.627443 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:34.710064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2aefa-2844-4b4b-8ac0-99a34671fa51 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:34.746827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:34.747451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.747763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.748033 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.759543 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:34.764284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:34.765246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:34.766252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 430/856] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Aug 23 22:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:15:34.772184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:34.816983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:34.875248 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77f0f-1f23-48cf-a343-3d45696f7704 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:34.911035 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:34.911702 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:34.911984 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:34.912259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:34.912989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:34.913290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:34.914817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:34.923353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 427/857] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Aug 23 22:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:34.929515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.019283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:35.035936 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751001-ff7d-46d1-a97a-1a065e0b94b2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:35.072231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:35.073157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:35.073855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:35.074009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:35.084416 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:35.085855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:35.101129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:35.102215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:35.103126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:35.103126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:35.103126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:35.103126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 431/858] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:35.108486 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.209059 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec3d61-9ede-4150-a138-63bda06768b9 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:35.211299 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:35.244051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:35.244666 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:35.246627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:35.246627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:35.246627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:35.246627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:35.247468 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:35.260247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 428/859] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:35.265919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.376757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e73b07-dfd9-44e8-ad88-a3bbf2be178a None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:35.411301 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:35.411947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:35.412219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:35.412485 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:35.415501 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:35.420729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:35.422170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:35.434091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:35.437762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:35.438950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 432/860] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:35.441336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.554525 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038edc5a-b6f8-443a-94a1-9b6cd0268b4c None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:35.590241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:35.590840 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:35.591134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:35.591378 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:35.592187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:35.592486 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:35.593884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:35.612927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 429/861] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:35.618875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.727939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5702a1-7384-4d6f-baf1-1181a8e6e152 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:35.764505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:35.765120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:35.765397 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:35.765669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:35.830995 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:35.838627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:35.840127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:35.948152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 433/862] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:35 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:35.954219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:35.980480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:36.061367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60240e-ccc4-4296-a50d-cf085575eddd None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:36.098923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:36.099499 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:36.099784 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:36.100099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:36.110719 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:36.112195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:36.127678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:36.129358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:36.130349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:36.130349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:36.130349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:36.130349 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 430/863] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:36.135829 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:36.239708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:36.245607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311fdd6-266a-4f0b-a88a-f6eb20aef3c4 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:36.280056 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:36.280741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:36.280918 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:36.281183 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:36.281817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:36.282116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:36.283471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:36.296659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 434/864] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:36.304453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:36.396521 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:36.429242 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f9a1f-2b4d-49ee-a34e-58b2b617b2d1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:36.469795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:36.470428 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:36.470707 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:36.470977 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:36.479940 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:36.481853 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:36.494626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:36.498199 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:36.500176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 431/865] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:36.503747 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:36.640490 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a366057-0475-41d1-afbb-eeb6ec323aa6 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:36.682085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:36.682751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:36.683035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:36.683311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:36.684121 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:36.684593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:36.685922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093eb5-f14f-4ffe-9554-a74a9f994352 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:36.700461 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 435/866] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:36.706790 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:36.821069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffda791-83b0-47c6-8e3d-f9794c56662d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:36.858045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:36.858660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:36.858932 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:36.859198 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:36.859955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] RBAC: Adding query filter params (role.id=f884d219ca994b198732bc1a7e26dfcf, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=1aec380fe79b477e907cc777efab1018) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:36.860257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:36.861735 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd54606-f085-4192-ad96-cb9ea242d34f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:36.863828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:36.868874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 432/867] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:36 2022] GET /identity/v3/role_assignments?user.id=1aec380fe79b477e907cc777efab1018&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=f884d219ca994b198732bc1a7e26dfcf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:39.163862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd860d-3204-47f1-a155-e01138b2a485 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.164479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd860d-3204-47f1-a155-e01138b2a485 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.164479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd860d-3204-47f1-a155-e01138b2a485 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.165715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 436/868] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:39.170953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.171407 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.171555 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.189911 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:39.191099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:39.259441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 433/869] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:15:39.600314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd860d-3204-47f1-a155-e01138b2a485 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:39.619367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:39.704350 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd860d-3204-47f1-a155-e01138b2a485 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:39.740150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:39.742345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.742345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.742345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.751547 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:39.756425 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:39.757601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:39.758685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 437/870] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:39.765957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:39.866311 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f25e-af28-4885-bb82-a140aecb2028 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:39.893620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:39.902220 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:39.902826 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:39.903102 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:39.903373 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:39.904073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:39.904374 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:39.905721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:39.914356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 434/871] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:39.920430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:39.999654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.023100 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addadab4-74f3-447b-a8ac-cf2585f45528 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.055673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.056287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.056560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.056824 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.067592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.072576 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:40.083333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:40.084495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:40.085392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:40.085392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:40.085392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:40.085392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 438/872] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:40.090322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.193332 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b6f3c-62fa-49ff-be12-c22855458763 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.229923 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.230522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.230796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.231060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.231714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:40.232011 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.233359 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.247089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 435/873] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:40.252885 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.357449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026ea7-b15a-4628-b17a-4aa2f0479e30 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.385170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.392879 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.393503 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.393775 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.394039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.401968 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.403552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:40.416009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:40.417111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:40.418182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 439/874] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:15:40.424482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.476151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.525580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ece25-2351-4e95-8bf4-8335fd5fab5f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.558323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.558845 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.559120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.559391 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.560144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:40.560448 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.561866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.579655 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 436/875] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:40.585461 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:40.688145 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4dac3-32a1-4c81-969b-2306a05e60dd None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:40.721339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:40.721936 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:40.722210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:40.722476 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:40.780260 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:40.792734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:40.796097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:40.895683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 440/876] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:15:40.901570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.007026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508f1ef-a563-4bc0-a685-b6c075840bf0 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.016865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:41.041132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.041684 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.041963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.042233 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.052585 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.054011 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:41.068625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:41.072595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:41.073544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:41.073544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:41.073544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:41.073544 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 437/877] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:41.075536 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.166655 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:41.178467 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5191a6-f574-4f09-9e38-f614514ae625 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.215122 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.215754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.216034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.216310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.216953 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:41.217251 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.218619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.231245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 441/878] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:41.237240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.347257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b77cc-c2ee-421b-9664-29463b870cd5 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.384366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.385010 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.385286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.385555 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.392838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.394301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:41.406517 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:41.407689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:41.408872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 438/879] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:41.414630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.517224 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caa1d6-068d-4a73-a3be-e6399dc3ced2 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.557030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.557689 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.557990 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.558259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.558945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:41.559246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.560742 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e937c-451d-4b62-88c6-52e5ba74e3a0 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.573178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 442/880] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:41.579215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:41.606035 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:41.683831 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27995a07-47a0-4a73-9210-219594795b0b None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:41.721433 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:41.722046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:41.722317 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:41.722583 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:41.723550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=1aec380fe79b477e907cc777efab1018) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:41.723856 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:41.725281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888936d4-dc95-43ad-84a5-42a892773da7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:41.730991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 439/881] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:41 2022] GET /identity/v3/role_assignments?user.id=1aec380fe79b477e907cc777efab1018&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:43.921165 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab1068-cd9b-46c3-bed3-7c33723e3368 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.921670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab1068-cd9b-46c3-bed3-7c33723e3368 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.921670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab1068-cd9b-46c3-bed3-7c33723e3368 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.922947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 443/882] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:43.928915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.929341 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.929464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.948423 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:43.949627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:44.018632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 440/883] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:44.358698 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab1068-cd9b-46c3-bed3-7c33723e3368 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.370058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.462054 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab1068-cd9b-46c3-bed3-7c33723e3368 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.496072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.496696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.496975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.497241 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.507753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:44.512387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:44.513637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:44.514701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 444/884] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:44.519467 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.535549 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.629124 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72623bb2-fc67-47ef-9daf-21d2834c87d6 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.664392 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.665002 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.665281 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.665546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.666204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:44.666499 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.667871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.677950 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 441/885] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:44.682739 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.750487 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.783566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54765629-2ea4-4c47-8b2c-7a2881badac1 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.818190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.818800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.819071 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.819333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.829624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.831058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:44.844715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:44.845777 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:44.846682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:44.846682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:44.846682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:44.846682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 445/886] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:44.851636 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:44.929792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:44.953025 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d1b5-577c-4fdc-9f45-a2879eabea00 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:44.989325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:44.989933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.990206 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.990472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.991116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:44.991415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:44.993297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.005653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 442/887] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:45.011564 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.117996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e6b92-8069-4205-909c-de5f76c4e7ea None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:45.138720 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:45.153944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:45.154592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:45.154872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:45.155132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:45.163762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:45.165205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:45.176302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:45.181638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:45.183767 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 446/888] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:45.185081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.285752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecba62-c1d1-497a-a6db-5674246c9356 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:45.321919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:45.322554 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:45.322887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:45.323101 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:45.323892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:45.324203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:45.327055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.328928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:45.347093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 443/889] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:45.354433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.467477 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dc151-20d8-4a23-b614-63029ab3138d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:45.503706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:45.504359 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:45.504641 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:45.504908 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:45.515669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:45.517152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:45.531679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:45.532899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:45.533822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:45.533822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:45.533822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:45.533822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 447/890] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:45.541239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.694081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2df12-81c3-46eb-8177-8154d6d50dcd None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:45.730432 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:45.730966 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:45.731243 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:45.731534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:45.732177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:45.732475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:45.733829 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.745972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 444/891] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:45.751925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.784115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:45.855120 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f5b06-0988-4e39-a24a-753d809c8eff None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:45.891007 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:45.891669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:45.891949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:45.892215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:45.899191 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:45.900676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:45.913396 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:45.914899 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:45.916089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 448/892] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:45.920476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:45.977980 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:46.023068 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3516c4-2d37-459e-8301-4c067943b833 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:46.055419 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:46.056056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:46.056327 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:46.056591 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:46.057270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:46.057568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:46.058962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6a5a-865d-4e39-a7a7-2e85228ce3fb None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:46.071613 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 445/893] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:46.077614 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:46.170139 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:46.179293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadbe-3b98-4491-bdb5-3c2df9d82754 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:46.214142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:46.214793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:46.215073 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:46.215347 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] PATH_INFO: `/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/1aec380fe79b477e907cc777efab1018/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:46.217278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ca8fa9fc80a41988acf49070a58c714, user_id=1aec380fe79b477e907cc777efab1018, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:46.218728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a0169-1156-4edb-a91f-7eb41b980a33 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:46.403471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 449/894] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Aug 23 22:15:46 2022] PUT /identity/v3/projects/2ca8fa9fc80a41988acf49070a58c714/users/1aec380fe79b477e907cc777efab1018/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:48.633218 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169867-f3ff-4691-879f-3df841f3fd68 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.633865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169867-f3ff-4691-879f-3df841f3fd68 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.633865 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc169867-f3ff-4691-879f-3df841f3fd68 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.635224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 446/895] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:48.641052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.641611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.641611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.660489 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:48.662305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:48.731433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 450/896] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:49.064599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc169867-f3ff-4691-879f-3df841f3fd68 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.171559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc169867-f3ff-4691-879f-3df841f3fd68 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.186850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:49.206541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.207174 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.208015 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.208443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.218469 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:15:49.223157 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:49.224787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:49.225658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 447/897] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:49.231272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.315637 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:49.333811 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4798c-e5ed-441a-a357-38e7c4c2d8a3 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.367671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.368310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.368586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.368851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.369498 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:49.369793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:49.371150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:49.379126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 451/898] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:49.385216 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.487786 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ebaeb-4d50-4487-b943-9dbce9d78e07 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.521534 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.522163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.522442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.522715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.532794 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:49.534235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:49.549339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:49.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:49.551850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:49.551850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:49.551850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:49.551850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 448/899] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:49.556664 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.659652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08946-95ab-48db-8755-07ce7ad7731d None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.693922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.694523 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.694895 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.695158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.695821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:49.696115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:49.697474 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:49.710958 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 452/900] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:49.716795 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.744214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:49.815742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085ac7d-6595-4929-90ef-5672c657204d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.851693 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.852321 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.852601 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.852867 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.860120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:49.861541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:15:49.872596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:49.873759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:49.874733 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 449/901] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:49.880142 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:49.883879 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:49.979206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe75431-8073-4c05-b128-592f5b529f3b None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:50.012499 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:50.013104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:50.013378 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:50.013644 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:50.014370 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:50.014666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:50.016124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:50.034348 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 453/902] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Aug 23 22:15:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:50.041144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:50.126585 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:50.141304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761ae78-98dd-48c5-ad23-ff21b15f0e0d None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:50.177402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:50.178215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:50.178492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:50.178765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:50.251211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:50.252631 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:50.353624 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:50.369415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 450/903] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Aug 23 22:15:50 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:15:50.375592 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:50.436693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:50.476646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c12cb3-d6b8-41b4-a5bc-2a63472d4e7f None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:50.509787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:50.510346 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:50.510627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:50.510900 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:50.522208 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:50.523688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:15:50.541333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:50.542571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:15:50.543937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:15:50.543937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:15:50.543937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:50.543937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 454/904] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:50.548326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:50.657266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9e45-73db-43b4-92d7-66466abcdde7 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:50.696663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:50.697277 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:50.697557 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:50.697847 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:50.698492 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:50.698802 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:50.700183 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:50.713264 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 451/905] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Aug 23 22:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:50.719055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:50.824245 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d866f-eaf8-430f-9cd0-e7a8e06813ab None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:50.839116 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:50.860209 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:50.862223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:50.862223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:50.862223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:50.868268 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:50.869698 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:15:50.880849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:50.881921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: ERROR keystone.server.flask.application Aug 23 22:15:50.883018 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 455/906] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Aug 23 22:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:50.887934 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:50.936547 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:50.989631 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319201d-a19c-4d6c-99eb-37a26cc1e2cf None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:51.024915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:51.025550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:51.025822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:51.026085 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:51.026767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:51.027066 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:51.028520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145e392-760c-46fa-b03b-022abd66cc6e None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:51.042044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 452/907] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Aug 23 22:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:51.048287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:51.151916 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdff4a-e53c-4a86-bb8e-64abbff2bf21 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:51.186118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:51.186713 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:51.186982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:51.187249 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:51.187985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] RBAC: Adding query filter params (role.id=9acf470ec24e45b6bdfefacf12e6b0a5, scope.project.id=2ca8fa9fc80a41988acf49070a58c714, user.id=1aec380fe79b477e907cc777efab1018) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:51.188284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:51.189699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8390-becb-4e0e-85b9-69e0b1026c4b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:51.195684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 456/908] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Aug 23 22:15:51 2022] GET /identity/v3/role_assignments?user.id=1aec380fe79b477e907cc777efab1018&scope.project.id=2ca8fa9fc80a41988acf49070a58c714&role.id=9acf470ec24e45b6bdfefacf12e6b0a5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:53.427237 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3407-38ca-4bab-86b3-1e0438b65d00 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:53.427892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3407-38ca-4bab-86b3-1e0438b65d00 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:53.427892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3407-38ca-4bab-86b3-1e0438b65d00 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:53.429195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 453/909] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:53.434513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:53.434937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:53.435053 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:53.453469 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:53.454654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:53.490449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:53.524531 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 457/910] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:53.844745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b3407-38ca-4bab-86b3-1e0438b65d00 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:53.957820 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b3407-38ca-4bab-86b3-1e0438b65d00 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:53.965485 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:53.993079 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:53.993744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:53.994028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:53.994298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:53.994887 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:53.996452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:15:54.006013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:15:54.007241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:15:54.008139 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 454/911] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Aug 23 22:15:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:15:54.013685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:54.118995 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653b88-eb56-4568-a78a-a9adaf4ca3be None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:54.153529 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:54.154137 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:54.154420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:54.154690 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:54.155320 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:54.155666 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:54.157043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fd91-9004-42cb-bf9c-1e55dec8ce2b None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:54.162584 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 458/912] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Aug 23 22:15:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:54.168362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:54.277103 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94b499-bd94-48d9-8a09-f5cc88bf5dd1 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:54.314654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:54.315264 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:54.315572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:54.315846 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] PATH_INFO: `/v3/services` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:54.316527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:54.316971 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:54.318377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fb5b1-b23e-4418-88c4-49c9f9cf6859 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:54.323434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 455/913] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Aug 23 22:15:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:15:56.811130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2256a-b3ca-49fc-85c2-569c27f470e2 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:56.811703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2256a-b3ca-49fc-85c2-569c27f470e2 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:56.811703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2256a-b3ca-49fc-85c2-569c27f470e2 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:56.813048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 459/914] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:56.818339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4d671-ac8e-48c2-ae8d-9eec04a640ac None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:56.818767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4d671-ac8e-48c2-ae8d-9eec04a640ac None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:56.818877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4d671-ac8e-48c2-ae8d-9eec04a640ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:56.837811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e2a4d671-ac8e-48c2-ae8d-9eec04a640ac None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:56.839053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e2a4d671-ac8e-48c2-ae8d-9eec04a640ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:56.867566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:56.909314 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 456/915] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:15:57.237150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2256a-b3ca-49fc-85c2-569c27f470e2 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:57.268906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:57.344167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2256a-b3ca-49fc-85c2-569c27f470e2 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:57.381648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:57.382259 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:57.382539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:57.382796 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:57.383430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:57.384818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7870922-383b-42d0-93b2-ec3655eb0a87 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:57.530723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 460/916] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Aug 23 22:15:57 2022] POST /identity/v3/services => generated 246 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:59.759403 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ae6-a047-4ef4-9cc0-f720c4941eb5 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:59.760005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ae6-a047-4ef4-9cc0-f720c4941eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:59.760005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ae6-a047-4ef4-9cc0-f720c4941eb5 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:59.761354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 457/917] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:59.766955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:59.767387 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:59.767521 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:59.785610 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:59.786821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:59.859249 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 461/918] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:16:00.194072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf11ae6-a047-4ef4-9cc0-f720c4941eb5 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:00.300797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf11ae6-a047-4ef4-9cc0-f720c4941eb5 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:00.338826 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:00.339454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.339759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.340028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.340609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:00.342100 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:16:00.350866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:16:00.352078 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:00.352942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 458/919] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Aug 23 22:16:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:16:00.358343 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:00.376854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.454825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd7006-cc4b-4f20-9fe6-fcf92d9e8f9b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:00.487591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:00.488192 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.488465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.488731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.489857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:16:00.490189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:00.491573 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:00.496473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 462/920] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Aug 23 22:16:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:16:00.502885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:00.531852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.600730 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a58ab-0d6f-468b-930a-6f24d46d6131 None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:00.639687 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:00.640309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.640587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.640860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.641570 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] RBAC: Adding query filter params (interface=public, service_id=5746cc03649940338c1e7b45bdffbbb0, region_id=RegionOne) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:16:00.641878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:00.643299 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3a21-272c-496e-97ff-96eb458efacd None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:00.649070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 459/921] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Aug 23 22:16:00 2022] GET /identity/v3/endpoints?service_id=5746cc03649940338c1e7b45bdffbbb0&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:16:00.654937 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:00.743682 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.762630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d216c-76c8-4f94-9e25-bee495be9771 None admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:00.797893 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:00.798679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.798820 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.799095 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.799730 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:00.801104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc5d33-3ba3-4698-bfec-823e3e6ea45d None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:00.808715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 463/922] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Aug 23 22:16:00 2022] GET /identity/v3/services => generated 1962 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:16:03.008604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d63aa-c7de-4ef8-ae07-1f083e138214 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:03.009129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d63aa-c7de-4ef8-ae07-1f083e138214 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:03.009129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d63aa-c7de-4ef8-ae07-1f083e138214 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:03.010457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 460/923] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:03.015677 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:03.016063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:03.016219 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:03.034952 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:03.036155 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:03.101693 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 464/924] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:03 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:16:03.434459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d63aa-c7de-4ef8-ae07-1f083e138214 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:03.526565 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:03.536000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d63aa-c7de-4ef8-ae07-1f083e138214 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:03.568981 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:03.569599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:03.569874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:03.570137 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:03.570701 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:03.572067 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:16:03.580294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:16:03.581457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application with Lock( Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: ERROR keystone.server.flask.application Aug 23 22:16:03.582660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 461/925] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Aug 23 22:16:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:16:03.588203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:03.674613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:03.699212 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d50d6f-d4c5-4921-b721-f9da09a4f880 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:03.732752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:03.733349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:03.733624 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:03.733939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] PATH_INFO: `/v3/services` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:03.734574 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:16:03.735084 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:03.737110 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc19f-62e6-4bca-aec4-7b932e175d86 None admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:03.742727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 465/926] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Aug 23 22:16:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:16:03.750034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:03.852828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3a8f-5f07-4a88-ac22-3a7b3797053f None admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:03.888809 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:03.889436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:03.889717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:03.889991 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:03.890686 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:03.892118 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0e779-0776-4475-9e6e-7ffbf21477f4 None admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:03.996210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 462/927] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:16:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:16:13.739221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=30 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:13.991361 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:14.064182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f5dfa-a9a5-41ff-bc95-7d6dc04d1f7e None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.065381 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f5dfa-a9a5-41ff-bc95-7d6dc04d1f7e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.065381 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f5dfa-a9a5-41ff-bc95-7d6dc04d1f7e None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.071507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 466/928] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:14.072933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391feec-1278-46de-a8d7-3f319a7a7f60 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.073482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391feec-1278-46de-a8d7-3f319a7a7f60 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.073482 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391feec-1278-46de-a8d7-3f319a7a7f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.179743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-a391feec-1278-46de-a8d7-3f319a7a7f60 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.181007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-a391feec-1278-46de-a8d7-3f319a7a7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.327567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 463/929] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.699516 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4379-ede4-4352-a7cc-325271dd8a88 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.699819 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4379-ede4-4352-a7cc-325271dd8a88 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.700094 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4379-ede4-4352-a7cc-325271dd8a88 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.701439 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 467/930] 10.222.0.50 () {54 vars in 965 bytes} [Tue Aug 23 22:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:14.707658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab160b-a69f-4352-af1d-b82e3948393e None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.708585 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab160b-a69f-4352-af1d-b82e3948393e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.708932 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab160b-a69f-4352-af1d-b82e3948393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.824622 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-c2ab160b-a69f-4352-af1d-b82e3948393e None None] MFA Rules not processed for user `b7eebced2e1c452abe1bd93520f0f6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.826003 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-c2ab160b-a69f-4352-af1d-b82e3948393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.859940 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:14.933099 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 464/931] 10.222.0.50 () {58 vars in 1062 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.940686 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4379-ede4-4352-a7cc-325271dd8a88 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.959308 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4379-ede4-4352-a7cc-325271dd8a88 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.965323 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.970825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.970825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.970825 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.980538 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.982729 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c5d4a-fe1d-4969-8006-e325b466845a service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.000263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 468/932] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:17.698055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd7ac-1124-4772-b35e-fe1c1c4c3761 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.698782 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd7ac-1124-4772-b35e-fe1c1c4c3761 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.698782 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcd7ac-1124-4772-b35e-fe1c1c4c3761 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.700316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 465/933] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:17.706153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc5cc-0c0f-492f-9dbd-cc0949d35f71 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.706731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc5cc-0c0f-492f-9dbd-cc0949d35f71 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.706731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1dc5cc-0c0f-492f-9dbd-cc0949d35f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.728244 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-3d1dc5cc-0c0f-492f-9dbd-cc0949d35f71 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:17.729494 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-3d1dc5cc-0c0f-492f-9dbd-cc0949d35f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:17.738606 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 469/934] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:18.088268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcd7ac-1124-4772-b35e-fe1c1c4c3761 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.102704 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcd7ac-1124-4772-b35e-fe1c1c4c3761 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.106510 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.107115 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.107446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.107743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.117773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.126007 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96120d1-f0c8-43ac-9b69-bc55b05f36cc service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.131530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 466/935] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:21.096804 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65309143-cf59-4c17-be70-65d493137b29 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:21.097341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65309143-cf59-4c17-be70-65d493137b29 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:21.097341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65309143-cf59-4c17-be70-65d493137b29 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:21.098822 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 470/936] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:21.104436 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334038-b411-4737-b0ed-df9bdad34d3f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:21.104861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334038-b411-4737-b0ed-df9bdad34d3f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:21.104992 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334038-b411-4737-b0ed-df9bdad34d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:21.167105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-75334038-b411-4737-b0ed-df9bdad34d3f None None] MFA Rules not processed for user `0bab3738a4f74cc083c625922f7d4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:21.168337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-75334038-b411-4737-b0ed-df9bdad34d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:21.258028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 467/937] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:21 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:21.608923 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65309143-cf59-4c17-be70-65d493137b29 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:21.621145 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65309143-cf59-4c17-be70-65d493137b29 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:21.624620 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:21.625213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:21.625483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:21.625748 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:21.635108 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:21.636566 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c108f-d3ae-4397-a46d-b26b19c16f7d service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:21.647919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 471/938] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:21 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:25.153046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20d2-d95d-4281-bdad-2b87f00a0cd3 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.153658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20d2-d95d-4281-bdad-2b87f00a0cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.153658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20d2-d95d-4281-bdad-2b87f00a0cd3 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.154990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 468/939] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:25.160718 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d43a8-f592-4375-b600-be7dcee8faf1 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.165639 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d43a8-f592-4375-b600-be7dcee8faf1 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.165639 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d43a8-f592-4375-b600-be7dcee8faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.184124 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-af2d43a8-f592-4375-b600-be7dcee8faf1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:25.185338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-af2d43a8-f592-4375-b600-be7dcee8faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:25.256136 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 472/940] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:25.606251 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f20d2-d95d-4281-bdad-2b87f00a0cd3 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.618556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f20d2-d95d-4281-bdad-2b87f00a0cd3 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.621999 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.622601 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.622877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.623140 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.633948 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.638076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb4b13-5f6c-44f3-a22f-1efae7d76ea2 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.648862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 469/941] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:29.212152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fc7ab-63ec-4553-86da-0a3674d9c4a1 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.212887 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fc7ab-63ec-4553-86da-0a3674d9c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.213131 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fc7ab-63ec-4553-86da-0a3674d9c4a1 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.214537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 473/942] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:29.220774 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e898a-f94b-4b42-8d50-a698b78f5913 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.221266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e898a-f94b-4b42-8d50-a698b78f5913 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.221379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e898a-f94b-4b42-8d50-a698b78f5913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.244745 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e90e898a-f94b-4b42-8d50-a698b78f5913 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:29.248319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e90e898a-f94b-4b42-8d50-a698b78f5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:29.256876 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 470/943] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:29.633696 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2209-7f8a-4501-92f1-2b283002cb4d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.634083 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2209-7f8a-4501-92f1-2b283002cb4d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.634434 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2209-7f8a-4501-92f1-2b283002cb4d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.635874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 474/944] 10.222.0.50 () {54 vars in 965 bytes} [Tue Aug 23 22:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:29.643453 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80754e2-fde3-4737-9213-2321de631975 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.643890 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80754e2-fde3-4737-9213-2321de631975 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.644218 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80754e2-fde3-4737-9213-2321de631975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.668290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d80754e2-fde3-4737-9213-2321de631975 None None] MFA Rules not processed for user `b7eebced2e1c452abe1bd93520f0f6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:29.669491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d80754e2-fde3-4737-9213-2321de631975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:29.676287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 471/945] 10.222.0.50 () {58 vars in 1062 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:29.685623 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2209-7f8a-4501-92f1-2b283002cb4d None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.698702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2209-7f8a-4501-92f1-2b283002cb4d None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.704956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.705701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.706016 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.706356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.717194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.718745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b8b13-4c1a-42d2-9adf-3943dc659e72 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.728783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 475/946] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:32.257005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99297e-8f34-4f70-9530-8ec4fc0cd126 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.257543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99297e-8f34-4f70-9530-8ec4fc0cd126 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.257543 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99297e-8f34-4f70-9530-8ec4fc0cd126 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.258804 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 472/947] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:25:32.264505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b533-d913-43d8-8b9b-cf3de982d075 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.265017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b533-d913-43d8-8b9b-cf3de982d075 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.265195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441b533-d913-43d8-8b9b-cf3de982d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.289793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a441b533-d913-43d8-8b9b-cf3de982d075 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:32.291299 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a441b533-d913-43d8-8b9b-cf3de982d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:32.299371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 476/948] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:32.655875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99297e-8f34-4f70-9530-8ec4fc0cd126 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:32.668738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99297e-8f34-4f70-9530-8ec4fc0cd126 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:32.672558 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:32.673170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:32.673445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:32.673715 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:32.683501 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:32.684946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27a3a-da5f-4af5-800b-d0e0890eefd6 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:32.695389 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 473/949] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:35.011646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e9ea-a861-4f2d-9b55-167bf73b0cb3 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.012172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e9ea-a861-4f2d-9b55-167bf73b0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.012172 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e9ea-a861-4f2d-9b55-167bf73b0cb3 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.013632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 477/950] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:35.019083 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad269f3-dbfd-4c94-9f14-a20522e591c3 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.019532 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad269f3-dbfd-4c94-9f14-a20522e591c3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.019789 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad269f3-dbfd-4c94-9f14-a20522e591c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.042112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-dad269f3-dbfd-4c94-9f14-a20522e591c3 None None] MFA Rules not processed for user `0bab3738a4f74cc083c625922f7d4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:35.043353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-dad269f3-dbfd-4c94-9f14-a20522e591c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:35.051596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 474/951] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:35 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:35.402145 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e9ea-a861-4f2d-9b55-167bf73b0cb3 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:35.414793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e9ea-a861-4f2d-9b55-167bf73b0cb3 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:35.418417 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:35.419021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.419292 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.419593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.429540 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:35.430983 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff006e-7645-4f82-b68f-dc39ade55dd9 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:35.441356 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 478/952] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:35 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:38.407241 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a2df-81f5-4dbf-ae21-1692078cb9c3 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.408125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a2df-81f5-4dbf-ae21-1692078cb9c3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.408125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a2df-81f5-4dbf-ae21-1692078cb9c3 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.409160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 475/953] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:38.417211 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbf15-6907-4327-b21a-123dfc04b76a None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.418062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbf15-6907-4327-b21a-123dfc04b76a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.418062 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdbf15-6907-4327-b21a-123dfc04b76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.439789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-76bdbf15-6907-4327-b21a-123dfc04b76a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:38.439789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-76bdbf15-6907-4327-b21a-123dfc04b76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:38.448012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 479/954] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:38.787008 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a2df-81f5-4dbf-ae21-1692078cb9c3 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:38.794109 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=100 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:38.798423 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a2df-81f5-4dbf-ae21-1692078cb9c3 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:38.807387 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:38.808061 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:38.808371 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:38.808596 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:38.826932 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:38.828425 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572b6a8-daa2-4c08-844d-a0850ee5b166 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:38.839479 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 476/955] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:41.234202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4773e7-0749-4972-908e-72d2c73b5a9a None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.234202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4773e7-0749-4972-908e-72d2c73b5a9a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.234202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4773e7-0749-4972-908e-72d2c73b5a9a None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.234202 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 480/956] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:25:41.240289 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913c31-c000-41c7-a770-b9c6148edbcd None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.240714 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913c31-c000-41c7-a770-b9c6148edbcd None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.241226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913c31-c000-41c7-a770-b9c6148edbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.265578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-84913c31-c000-41c7-a770-b9c6148edbcd None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:41.267661 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-84913c31-c000-41c7-a770-b9c6148edbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:41.276623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 477/957] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:41.625181 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4773e7-0749-4972-908e-72d2c73b5a9a None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:41.637205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4773e7-0749-4972-908e-72d2c73b5a9a None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:41.640764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:41.641360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:41.641628 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:41.641889 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:41.652284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:41.661694 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c3e60-af8b-4e41-b296-57a536a740f2 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:41.664392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 481/958] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:44.795228 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cefb-07b3-4934-9cec-3f91637052cb None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:44.795823 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cefb-07b3-4934-9cec-3f91637052cb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:44.795929 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080cefb-07b3-4934-9cec-3f91637052cb None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:44.797229 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 478/959] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:44.802646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185171c-d36d-4c8d-942b-ff68a4da443d None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:44.803149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185171c-d36d-4c8d-942b-ff68a4da443d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:44.803149 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185171c-d36d-4c8d-942b-ff68a4da443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:44.810578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=71 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:44.823075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a185171c-d36d-4c8d-942b-ff68a4da443d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:44.824302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a185171c-d36d-4c8d-942b-ff68a4da443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:44.832817 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 482/960] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:44 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:45.173014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cefb-07b3-4934-9cec-3f91637052cb None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.184709 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080cefb-07b3-4934-9cec-3f91637052cb None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.188252 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.188897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.189177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.189449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.199651 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.201072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658637f-5434-44cd-b208-50b41283c44b service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.210717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 479/961] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:45 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:50.086335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ea3aa-5d70-4892-b1cb-532ad186fc99 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.086860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ea3aa-5d70-4892-b1cb-532ad186fc99 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.086860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ea3aa-5d70-4892-b1cb-532ad186fc99 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.088164 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 483/962] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:50.093652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ff65-60d1-4e4c-8e6d-e7f7908aecd7 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.099574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ff65-60d1-4e4c-8e6d-e7f7908aecd7 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.099574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ff65-60d1-4e4c-8e6d-e7f7908aecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.116044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-9b06ff65-60d1-4e4c-8e6d-e7f7908aecd7 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:50.117396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-9b06ff65-60d1-4e4c-8e6d-e7f7908aecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.125571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 480/963] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:50.470765 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ea3aa-5d70-4892-b1cb-532ad186fc99 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.482286 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ea3aa-5d70-4892-b1cb-532ad186fc99 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.485838 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.486422 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.486686 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.486989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.496613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.498019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b671-f68a-438f-b5e1-2bc27ecb2aba service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.507394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 484/964] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:53.702414 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4c86-f664-46fb-acd5-119819e719f2 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.702970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4c86-f664-46fb-acd5-119819e719f2 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.702970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a4c86-f664-46fb-acd5-119819e719f2 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.704223 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 481/965] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:53.710220 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee26b-ed16-48b2-8f1e-d675fc806012 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.710676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee26b-ed16-48b2-8f1e-d675fc806012 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.710820 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee26b-ed16-48b2-8f1e-d675fc806012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.729751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9f8ee26b-ed16-48b2-8f1e-d675fc806012 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:53.730891 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9f8ee26b-ed16-48b2-8f1e-d675fc806012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:53.738799 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 485/966] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:53 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:54.081164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a4c86-f664-46fb-acd5-119819e719f2 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:54.092982 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a4c86-f664-46fb-acd5-119819e719f2 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:54.096217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:54.096817 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:54.097089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:54.097356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:54.107740 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:54.109266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e54723-69f8-4fbe-9613-7dbbe017f0d7 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:54.119167 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 482/967] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:54 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:58.725508 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04acb-461f-4129-be3d-1b4e61462238 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.726031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04acb-461f-4129-be3d-1b4e61462238 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.726031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04acb-461f-4129-be3d-1b4e61462238 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.727309 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 486/968] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:25:58.733069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c51247-bf2d-44fb-b5d5-f3a8c3cc2749 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.733479 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c51247-bf2d-44fb-b5d5-f3a8c3cc2749 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.733749 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c51247-bf2d-44fb-b5d5-f3a8c3cc2749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.754045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-87c51247-bf2d-44fb-b5d5-f3a8c3cc2749 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:58.756164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-87c51247-bf2d-44fb-b5d5-f3a8c3cc2749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:58.764113 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 483/969] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:59.111783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04acb-461f-4129-be3d-1b4e61462238 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:59.124265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04acb-461f-4129-be3d-1b4e61462238 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:59.127798 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:59.128404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:59.128679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:59.128949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:59.139193 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:59.140669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0d3b-2061-4ed8-86ac-23020b6a7648 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:59.150412 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 487/970] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:04.710480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6a90-8bb0-44ee-ae9b-5d34a76a7e74 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.710960 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6a90-8bb0-44ee-ae9b-5d34a76a7e74 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.711056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6a90-8bb0-44ee-ae9b-5d34a76a7e74 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.712711 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 484/971] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:04.717654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a6e9-8598-457b-9915-249c594874b7 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.718065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a6e9-8598-457b-9915-249c594874b7 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.718185 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a6e9-8598-457b-9915-249c594874b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.774660 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-60d7a6e9-8598-457b-9915-249c594874b7 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:04.777006 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-60d7a6e9-8598-457b-9915-249c594874b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:04.893061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 488/972] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:26:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:08.749491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=25 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:09.571963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba07e-3bb4-4f10-90b5-3b58afa7c1c3 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:09.572233 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba07e-3bb4-4f10-90b5-3b58afa7c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:09.572670 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ba07e-3bb4-4f10-90b5-3b58afa7c1c3 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:09.574367 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 485/973] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:09.579526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b559f-a259-4c1b-a096-661a089a60af None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:09.580045 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b559f-a259-4c1b-a096-661a089a60af None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:09.580127 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b559f-a259-4c1b-a096-661a089a60af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:09.601190 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-bc0b559f-a259-4c1b-a096-661a089a60af None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:09.602053 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-bc0b559f-a259-4c1b-a096-661a089a60af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:09.611632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 489/974] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:26:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:11.110691 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507face-6cd3-4d8d-814f-6dbf604a95eb None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:11.111215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507face-6cd3-4d8d-814f-6dbf604a95eb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:11.111215 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507face-6cd3-4d8d-814f-6dbf604a95eb None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:11.112572 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 486/975] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:11.118783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d958d-1297-4953-beee-cc5dd0f4e497 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:11.119237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d958d-1297-4953-beee-cc5dd0f4e497 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:11.119374 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d958d-1297-4953-beee-cc5dd0f4e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:11.139158 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-098d958d-1297-4953-beee-cc5dd0f4e497 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:11.140400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-098d958d-1297-4953-beee-cc5dd0f4e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:11.149195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 490/976] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:26:11 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:15.191614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8396e-c900-4194-a903-5fbf53c65abc None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:15.192134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8396e-c900-4194-a903-5fbf53c65abc None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:15.192134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8396e-c900-4194-a903-5fbf53c65abc None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:15.194982 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 487/977] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:15.201152 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796b96-0857-4224-aae4-c725f25280f7 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:15.202333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796b96-0857-4224-aae4-c725f25280f7 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:15.202333 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796b96-0857-4224-aae4-c725f25280f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:15.210214 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=68 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:15.226871 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-cf796b96-0857-4224-aae4-c725f25280f7 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:15.229042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-cf796b96-0857-4224-aae4-c725f25280f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:15.238507 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 491/978] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:15.602458 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f839-7c3f-412a-ba33-a7127d6127c0 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:15.603566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f839-7c3f-412a-ba33-a7127d6127c0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:15.604478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f839-7c3f-412a-ba33-a7127d6127c0 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:15.608901 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 488/979] 10.222.0.50 () {54 vars in 962 bytes} [Tue Aug 23 22:26:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:26:15.623067 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd43f-6406-4390-ab66-6130a792d579 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:15.623379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd43f-6406-4390-ab66-6130a792d579 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:15.624590 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acd43f-6406-4390-ab66-6130a792d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:15.681752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-93acd43f-6406-4390-ab66-6130a792d579 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:15.683455 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-93acd43f-6406-4390-ab66-6130a792d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:15.762740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 492/980] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Aug 23 22:26:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:15.770154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f839-7c3f-412a-ba33-a7127d6127c0 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:15.784176 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f839-7c3f-412a-ba33-a7127d6127c0 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:15.789994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:15.791648 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:15.792454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:15.792978 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:15.802015 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:15.804631 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60a84-3833-40a4-bd00-19e771b75036 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:15.815217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 489/981] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:18.370412 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c0cb-675c-4508-8854-be744a303789 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:18.370944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c0cb-675c-4508-8854-be744a303789 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:18.370944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07c0cb-675c-4508-8854-be744a303789 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:18.372472 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 493/982] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:18.377694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2cdc-7aae-45ac-bbf9-36638d70949a None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:18.378148 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2cdc-7aae-45ac-bbf9-36638d70949a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:18.378236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2cdc-7aae-45ac-bbf9-36638d70949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:18.398860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-b03b2cdc-7aae-45ac-bbf9-36638d70949a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:18.400107 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-b03b2cdc-7aae-45ac-bbf9-36638d70949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:18.409939 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 490/983] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:18.757617 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07c0cb-675c-4508-8854-be744a303789 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:18.772657 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07c0cb-675c-4508-8854-be744a303789 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:18.777665 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:18.778265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:18.778539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:18.778807 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:18.789499 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:18.790353 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9175f07-52ec-4dea-a3ac-28cf784649e4 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:18.800602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 494/984] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:21.639937 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98282-260f-49b0-b696-eb1b692a0990 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:21.640434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98282-260f-49b0-b696-eb1b692a0990 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:21.640434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d98282-260f-49b0-b696-eb1b692a0990 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:21.642190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 491/985] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:21.647757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9658e6-05fe-4bed-bed5-232e5a86d696 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:21.648252 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9658e6-05fe-4bed-bed5-232e5a86d696 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:21.648346 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9658e6-05fe-4bed-bed5-232e5a86d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:21.670427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fa9658e6-05fe-4bed-bed5-232e5a86d696 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:21.671683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fa9658e6-05fe-4bed-bed5-232e5a86d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:21.679546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 495/986] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:22.043742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c194-f68d-42fc-9e6a-16626ac8657f None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:22.044116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c194-f68d-42fc-9e6a-16626ac8657f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:22.044395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5c194-f68d-42fc-9e6a-16626ac8657f None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:22.046186 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 492/987] 10.222.0.50 () {54 vars in 962 bytes} [Tue Aug 23 22:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:22.054944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130914f9-a9e9-4c29-8fa1-4ebd7f10247f None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:22.055233 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130914f9-a9e9-4c29-8fa1-4ebd7f10247f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:22.055733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130914f9-a9e9-4c29-8fa1-4ebd7f10247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:22.079200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-130914f9-a9e9-4c29-8fa1-4ebd7f10247f None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:22.080874 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-130914f9-a9e9-4c29-8fa1-4ebd7f10247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:22.091802 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 496/988] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Aug 23 22:26:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:22.099363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c194-f68d-42fc-9e6a-16626ac8657f None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:22.114742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5c194-f68d-42fc-9e6a-16626ac8657f None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:22.120800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:22.121756 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:22.122221 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:22.122689 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:22.133132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:22.135088 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00f441-dab7-4585-addc-b091d692e66d service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:22.147862 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 493/989] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:24.761277 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450868d-2f66-4781-873d-a06076257939 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:24.762306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450868d-2f66-4781-873d-a06076257939 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:24.762797 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450868d-2f66-4781-873d-a06076257939 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:24.768662 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 497/990] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:24.771365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6da49-b712-446c-a75c-18b0a1054baa None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:24.771365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6da49-b712-446c-a75c-18b0a1054baa None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:24.771365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6da49-b712-446c-a75c-18b0a1054baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:24.792481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-cbd6da49-b712-446c-a75c-18b0a1054baa None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:24.794294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-cbd6da49-b712-446c-a75c-18b0a1054baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:24.803086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 494/991] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:25.164421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450868d-2f66-4781-873d-a06076257939 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:25.184354 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450868d-2f66-4781-873d-a06076257939 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:25.190476 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:25.191420 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:25.191947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:25.192447 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:25.203876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:25.206225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39d02b-8b65-48da-93da-700efd3e2c7e service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:25.230038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 498/992] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:26:26.032364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95214-5eca-4781-8f45-7196830b5da8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:26.032830 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95214-5eca-4781-8f45-7196830b5da8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:26.033072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd95214-5eca-4781-8f45-7196830b5da8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:26.040595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4116c0-5fe0-45bd-9ff4-4ee74afb8a03 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:26.040997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4116c0-5fe0-45bd-9ff4-4ee74afb8a03 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:26.041147 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4116c0-5fe0-45bd-9ff4-4ee74afb8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:26.044132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 495/993] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:26.062470 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-cc4116c0-5fe0-45bd-9ff4-4ee74afb8a03 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:26.063654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-cc4116c0-5fe0-45bd-9ff4-4ee74afb8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:26.091118 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 499/994] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:26.824207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd683c-14c3-4ad0-8e84-52e27074bee6 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:26.824207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd683c-14c3-4ad0-8e84-52e27074bee6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:26.824207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd683c-14c3-4ad0-8e84-52e27074bee6 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:26.824207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 496/995] 10.222.0.50 () {54 vars in 964 bytes} [Tue Aug 23 22:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:26.829658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d575-cbdc-42da-9cde-14b58cd51506 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:26.829927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d575-cbdc-42da-9cde-14b58cd51506 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:26.830208 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d575-cbdc-42da-9cde-14b58cd51506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:26.892947 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a6f7d575-cbdc-42da-9cde-14b58cd51506 None None] MFA Rules not processed for user `3b13ed7288ab43e08f7b842927e77d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:26.894234 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a6f7d575-cbdc-42da-9cde-14b58cd51506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:26.947799 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=100 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:26.965761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 500/996] 10.222.0.50 () {58 vars in 1061 bytes} [Tue Aug 23 22:26:26 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:26.974131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd683c-14c3-4ad0-8e84-52e27074bee6 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:26.988235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd683c-14c3-4ad0-8e84-52e27074bee6 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:26.993622 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b13ed7288ab43e08f7b842927e77d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:26.994323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:26.994671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:26.994942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:27.005307 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:27.006931 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd840f-37a7-4d6d-b57f-7c85e46eec87 service cinder] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:27.018527 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 497/997] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:27.738524 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841731-f648-4e03-8b41-da9d5800c799 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:27.739081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841731-f648-4e03-8b41-da9d5800c799 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:27.739081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a841731-f648-4e03-8b41-da9d5800c799 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:27.740426 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 501/998] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:27.746509 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949e4c-15e0-4ec7-bfad-a80e289d394f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:27.746972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949e4c-15e0-4ec7-bfad-a80e289d394f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:27.747066 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f949e4c-15e0-4ec7-bfad-a80e289d394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:27.767588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-3f949e4c-15e0-4ec7-bfad-a80e289d394f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:27.768835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-3f949e4c-15e0-4ec7-bfad-a80e289d394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:27.777523 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 498/999] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:28.141673 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a841731-f648-4e03-8b41-da9d5800c799 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:28.171647 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a841731-f648-4e03-8b41-da9d5800c799 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:28.177027 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:28.177576 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:28.177858 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:28.178125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:28.188290 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:28.189933 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84682ab-da87-4ea5-9f2f-165ac754862f service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:28.200510 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 502/1000] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:30.686663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ef1b-ff49-4c38-b665-94f68ecd6233 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:30.687353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ef1b-ff49-4c38-b665-94f68ecd6233 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:30.687353 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ef1b-ff49-4c38-b665-94f68ecd6233 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:30.688571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 499/1001] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:30.694034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deddfbc-39e1-461a-984d-b9b5204485ae None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:30.694511 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deddfbc-39e1-461a-984d-b9b5204485ae None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:30.694603 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deddfbc-39e1-461a-984d-b9b5204485ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:30.714512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-4deddfbc-39e1-461a-984d-b9b5204485ae None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:30.715717 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-4deddfbc-39e1-461a-984d-b9b5204485ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:30.723909 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 503/1002] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:31.077014 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7ef1b-ff49-4c38-b665-94f68ecd6233 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:31.100669 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7ef1b-ff49-4c38-b665-94f68ecd6233 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:31.110599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:31.111459 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:31.112800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:31.113271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:31.124812 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:31.126660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfab3e-5962-4178-b3f2-e3b95439c4de service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:31.140142 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 500/1003] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:33.587189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871257c-8560-4525-8cae-b6ac2dca9d9f None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:33.587927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871257c-8560-4525-8cae-b6ac2dca9d9f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:33.587927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871257c-8560-4525-8cae-b6ac2dca9d9f None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:33.589097 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 504/1004] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:33.594796 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b1eb-6337-40d4-8a12-0ff14f870eec None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:33.595302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b1eb-6337-40d4-8a12-0ff14f870eec None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:33.595441 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894b1eb-6337-40d4-8a12-0ff14f870eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:33.615779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4894b1eb-6337-40d4-8a12-0ff14f870eec None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:33.617282 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4894b1eb-6337-40d4-8a12-0ff14f870eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:33.625522 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 501/1005] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:33.982731 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871257c-8560-4525-8cae-b6ac2dca9d9f None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:34.000621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871257c-8560-4525-8cae-b6ac2dca9d9f None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:34.007404 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:34.008508 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:34.009009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:34.009572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:34.024026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:34.026559 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ffa5d-1088-4f80-bed8-7e57e9eb244f service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:34.040955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 505/1006] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:36.338175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17aafe-e33d-4a63-a312-636c281f0f4a None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.338755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17aafe-e33d-4a63-a312-636c281f0f4a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.338755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17aafe-e33d-4a63-a312-636c281f0f4a None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.340111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 502/1007] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:36.345640 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e076-a7a5-4bdd-8595-1916a8c9b38f None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.346169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e076-a7a5-4bdd-8595-1916a8c9b38f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.346169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e076-a7a5-4bdd-8595-1916a8c9b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.367906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-1b22e076-a7a5-4bdd-8595-1916a8c9b38f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:36.369182 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-1b22e076-a7a5-4bdd-8595-1916a8c9b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:36.377539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 506/1008] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:36.759986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17aafe-e33d-4a63-a312-636c281f0f4a None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:36.776067 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17aafe-e33d-4a63-a312-636c281f0f4a None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:36.781614 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:36.782290 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.782586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.782884 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.794741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:36.796475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742342cb-3a98-486d-8de2-aa70ed11d897 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:36.808333 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 503/1009] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:40.999478 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434eb2-6f4d-493a-ae26-bb63e7cb9e82 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:41.000262 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434eb2-6f4d-493a-ae26-bb63e7cb9e82 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:41.000262 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434eb2-6f4d-493a-ae26-bb63e7cb9e82 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:41.001530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 507/1010] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:41.008429 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b80ef-ae63-4610-90e2-18edf1ba2cfb None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:41.009029 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b80ef-ae63-4610-90e2-18edf1ba2cfb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:41.009029 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b80ef-ae63-4610-90e2-18edf1ba2cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:41.017214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=43 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:41.033111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4c5b80ef-ae63-4610-90e2-18edf1ba2cfb None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:41.034383 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4c5b80ef-ae63-4610-90e2-18edf1ba2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:41.043962 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 504/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:41.427130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3434eb2-6f4d-493a-ae26-bb63e7cb9e82 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:41.448977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3434eb2-6f4d-493a-ae26-bb63e7cb9e82 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:41.454395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:41.455043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:41.455358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:41.455765 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:41.466836 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:41.468614 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b20d7-8aab-4d2d-a802-219890edf6cf service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:41.485451 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 508/1012] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:43.876697 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d813e-1162-4476-8a4f-2d6dae457699 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:43.877216 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d813e-1162-4476-8a4f-2d6dae457699 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:43.877322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d813e-1162-4476-8a4f-2d6dae457699 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:43.878586 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 505/1013] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:43.884772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9493-5797-461d-9163-731820c9cf15 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:43.885440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9493-5797-461d-9163-731820c9cf15 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:43.885440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9493-5797-461d-9163-731820c9cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:43.905365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-7dee9493-5797-461d-9163-731820c9cf15 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:43.906571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-7dee9493-5797-461d-9163-731820c9cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:43.914867 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 509/1014] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:44.137111 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45469f-3643-49b5-bb8c-a6de54612733 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.137388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45469f-3643-49b5-bb8c-a6de54612733 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.137665 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45469f-3643-49b5-bb8c-a6de54612733 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.138993 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 506/1015] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:44.144518 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a241c7-77d4-494d-a1a6-5401d29f812b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.144803 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a241c7-77d4-494d-a1a6-5401d29f812b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.145077 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a241c7-77d4-494d-a1a6-5401d29f812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.164150 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-f4a241c7-77d4-494d-a1a6-5401d29f812b None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:44.165391 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-f4a241c7-77d4-494d-a1a6-5401d29f812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:44.173489 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 510/1016] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:44.276644 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497128-1884-4ab9-ae26-b103c79ebf04 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.276957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497128-1884-4ab9-ae26-b103c79ebf04 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.277235 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74497128-1884-4ab9-ae26-b103c79ebf04 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.278573 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 507/1017] 10.222.0.50 () {54 vars in 967 bytes} [Tue Aug 23 22:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:44.283932 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.284284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.284561 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.337061 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] MFA Rules not processed for user `6f428da0321f49fa81fa70bcdddeaf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:44.338264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:44.399400 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 511/1018] 10.222.0.50 () {58 vars in 1064 bytes} [Tue Aug 23 22:26:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:44.406755 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497128-1884-4ab9-ae26-b103c79ebf04 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:44.419086 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74497128-1884-4ab9-ae26-b103c79ebf04 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:44.422658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f428da0321f49fa81fa70bcdddeaf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:44.423286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.423588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.423956 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.433309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:44.434734 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16251db2-77bd-4a29-a50e-3e07c4ff3078 service glance] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:44.444138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 508/1019] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:44.541854 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:44.548560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b32be1-b761-443a-8c80-fdea0eb93635 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:44.554727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:44.555417 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.555793 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.556130 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.565153 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:44.568676 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ee037-d87c-451d-8ab2-2789c9970091 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:44.576525 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 512/1020] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:47.040550 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dcc5-96ff-49fa-909c-08248f9bd380 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:47.041580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dcc5-96ff-49fa-909c-08248f9bd380 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:47.041580 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319dcc5-96ff-49fa-909c-08248f9bd380 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:47.042739 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 509/1021] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:26:47.048609 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44268-be4c-4c30-9985-a2cdf10e0c7d None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:47.049416 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44268-be4c-4c30-9985-a2cdf10e0c7d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:47.049416 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab44268-be4c-4c30-9985-a2cdf10e0c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:47.072059 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-2ab44268-be4c-4c30-9985-a2cdf10e0c7d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:47.073353 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-2ab44268-be4c-4c30-9985-a2cdf10e0c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:47.087471 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 513/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:47.464481 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319dcc5-96ff-49fa-909c-08248f9bd380 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:47.481536 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319dcc5-96ff-49fa-909c-08248f9bd380 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:47.492503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:47.493454 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:47.493738 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:47.494048 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:47.503669 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:47.505269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460adc0-4bd0-450e-a02b-3b39d4738626 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:47.521071 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 510/1023] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:50.329278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557570-9b8d-4b0e-9136-2b5b7c149a4d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.329991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557570-9b8d-4b0e-9136-2b5b7c149a4d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.329991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557570-9b8d-4b0e-9136-2b5b7c149a4d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.331166 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 514/1024] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:26:50.337466 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c3f3c-e947-4b47-bc88-3a1643562383 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.338044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c3f3c-e947-4b47-bc88-3a1643562383 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.338044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c3f3c-e947-4b47-bc88-3a1643562383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.361878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-df0c3f3c-e947-4b47-bc88-3a1643562383 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:50.361878 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-df0c3f3c-e947-4b47-bc88-3a1643562383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:50.372322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 511/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:26:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:50.734740 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557570-9b8d-4b0e-9136-2b5b7c149a4d None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:50.752091 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557570-9b8d-4b0e-9136-2b5b7c149a4d None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:50.757706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:50.758488 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.759093 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.759254 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.768708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:50.770434 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fa72d-fa06-4b43-8cfd-f0fcd824c8ba service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:50.781897 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 515/1026] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:00.354438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=17 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:00.777282 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=88 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:00.927283 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583ea0-04a5-4495-82df-27395e5ee0c8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:00.927660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583ea0-04a5-4495-82df-27395e5ee0c8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:00.927810 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583ea0-04a5-4495-82df-27395e5ee0c8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:00.929149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 512/1027] 10.222.0.50 () {54 vars in 918 bytes} [Tue Aug 23 22:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:00.934438 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1445-97c3-41a1-9bfa-83754522c1f6 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:00.934714 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1445-97c3-41a1-9bfa-83754522c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:00.934980 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1445-97c3-41a1-9bfa-83754522c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:00.955521 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-0d9f1445-97c3-41a1-9bfa-83754522c1f6 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:00.956816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-0d9f1445-97c3-41a1-9bfa-83754522c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:00.966132 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 516/1028] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Aug 23 22:27:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:00.980906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358f710-e564-47a2-962f-26e7e3ff5b4e None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:00.981190 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358f710-e564-47a2-962f-26e7e3ff5b4e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:00.981464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358f710-e564-47a2-962f-26e7e3ff5b4e None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:00.982784 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 513/1029] 10.222.0.50 () {54 vars in 918 bytes} [Tue Aug 23 22:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:00.989204 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f1a9-aec3-4e6f-94c7-b4362ade5664 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:00.989483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f1a9-aec3-4e6f-94c7-b4362ade5664 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:00.989754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f1a9-aec3-4e6f-94c7-b4362ade5664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:01.010986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-78c4f1a9-aec3-4e6f-94c7-b4362ade5664 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:01.012237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-78c4f1a9-aec3-4e6f-94c7-b4362ade5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:01.020982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 517/1030] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Aug 23 22:27:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:03.764177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa87a17-c328-4108-b6f0-3f1addceeb36 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:03.764783 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa87a17-c328-4108-b6f0-3f1addceeb36 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:03.765077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa87a17-c328-4108-b6f0-3f1addceeb36 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:03.766952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:03.772577 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa92af-e61b-4436-bada-4aa0204699ad None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:03.773203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa92af-e61b-4436-bada-4aa0204699ad None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:03.773203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa92af-e61b-4436-bada-4aa0204699ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:03.794527 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-c8fa92af-e61b-4436-bada-4aa0204699ad None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:03.795763 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-c8fa92af-e61b-4436-bada-4aa0204699ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:03.803395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:04.149250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa87a17-c328-4108-b6f0-3f1addceeb36 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:04.162491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa87a17-c328-4108-b6f0-3f1addceeb36 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:04.168399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:04.168986 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:04.169258 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:04.169526 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:04.177434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:04.178994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5b64-fa7f-415b-82ee-310f0618567b service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:04.189144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 515/1033] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:05.158441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a111a-f33c-4abd-8a3f-7b93c2ca6277 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:05.159019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a111a-f33c-4abd-8a3f-7b93c2ca6277 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:05.159019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a111a-f33c-4abd-8a3f-7b93c2ca6277 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:05.160352 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:05.165970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b787d6-ffcd-483f-a1e8-70b4cbf44777 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:05.166418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b787d6-ffcd-483f-a1e8-70b4cbf44777 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:05.166533 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b787d6-ffcd-483f-a1e8-70b4cbf44777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:05.186699 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-25b787d6-ffcd-483f-a1e8-70b4cbf44777 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:05.191312 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-25b787d6-ffcd-483f-a1e8-70b4cbf44777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:05.196605 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:05.390889 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a111a-f33c-4abd-8a3f-7b93c2ca6277 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:05.404358 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a111a-f33c-4abd-8a3f-7b93c2ca6277 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:05.409494 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:05.410026 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:05.410306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:05.410571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:05.418893 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:05.420498 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29ff7-96f4-479d-a566-fb87b8b92486 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:05.430435 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 520/1036] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:06.376036 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d3eb-dfd1-4b81-9e60-add555099f82 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:06.376600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d3eb-dfd1-4b81-9e60-add555099f82 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:06.376600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d3eb-dfd1-4b81-9e60-add555099f82 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:06.377913 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:06.383014 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd4d0-ce1f-4879-a4f6-a97f61628fa9 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:06.383504 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd4d0-ce1f-4879-a4f6-a97f61628fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:06.383616 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cd4d0-ce1f-4879-a4f6-a97f61628fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:06.402894 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-739cd4d0-ce1f-4879-a4f6-a97f61628fa9 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:06.404126 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-739cd4d0-ce1f-4879-a4f6-a97f61628fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:06.411968 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:06.570087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d3eb-dfd1-4b81-9e60-add555099f82 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:06.584578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d3eb-dfd1-4b81-9e60-add555099f82 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:06.593652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:06.595026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:06.595303 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:06.595604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:06.604696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:06.606274 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735763d1-7cc4-4878-be9e-e579a5079172 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:06.616777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 518/1039] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:07.503790 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2344-dbc6-41c9-96c8-2350fad37f6d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:07.504338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2344-dbc6-41c9-96c8-2350fad37f6d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:07.504338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2344-dbc6-41c9-96c8-2350fad37f6d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:07.505658 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:07.511287 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b9c0b-a835-4690-ad3c-4c36d92fb174 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:07.511763 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b9c0b-a835-4690-ad3c-4c36d92fb174 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:07.511906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b9c0b-a835-4690-ad3c-4c36d92fb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:07.530915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-249b9c0b-a835-4690-ad3c-4c36d92fb174 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:07.532150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-249b9c0b-a835-4690-ad3c-4c36d92fb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:07.540160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:07.698784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2344-dbc6-41c9-96c8-2350fad37f6d None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:07.712779 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2344-dbc6-41c9-96c8-2350fad37f6d None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:07.717715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:07.718310 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:07.718581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:07.718845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:07.728255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:07.729884 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d32353-820a-44cd-85d3-680dd462aa75 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:07.739680 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 523/1042] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:08.638464 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c10e2-19b4-4a89-99ef-f4aed5a71410 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:08.639045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c10e2-19b4-4a89-99ef-f4aed5a71410 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:08.639045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c10e2-19b4-4a89-99ef-f4aed5a71410 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:08.640496 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:08.645861 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495e53d-b6e4-400e-9ff6-196dc2362f9d None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:08.646345 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495e53d-b6e4-400e-9ff6-196dc2362f9d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:08.646458 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495e53d-b6e4-400e-9ff6-196dc2362f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:08.667984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-b495e53d-b6e4-400e-9ff6-196dc2362f9d None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:08.669235 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-b495e53d-b6e4-400e-9ff6-196dc2362f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:08.677216 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:08.837757 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c10e2-19b4-4a89-99ef-f4aed5a71410 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:08.853210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c10e2-19b4-4a89-99ef-f4aed5a71410 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:08.858165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:08.858771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:08.859050 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:08.859602 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:08.871635 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:08.873212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec503-eebe-49a6-9ba4-042c5ac9bed3 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:08.882805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 521/1045] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:09.794724 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31790-9424-48f5-844e-03e447b2ed4c None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:09.795314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31790-9424-48f5-844e-03e447b2ed4c None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:09.795314 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d31790-9424-48f5-844e-03e447b2ed4c None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:09.796670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:09.801910 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e2ec-cb33-4eac-8bbe-2540f4df63ff None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:09.802379 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e2ec-cb33-4eac-8bbe-2540f4df63ff None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:09.802513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e2ec-cb33-4eac-8bbe-2540f4df63ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:09.823447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-c604e2ec-cb33-4eac-8bbe-2540f4df63ff None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:09.824706 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-c604e2ec-cb33-4eac-8bbe-2540f4df63ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:09.835077 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:10.012390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31790-9424-48f5-844e-03e447b2ed4c None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:10.026363 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d31790-9424-48f5-844e-03e447b2ed4c None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:10.031597 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:10.032231 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:10.032505 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:10.032772 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:10.042808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:10.044571 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945285f7-13d7-43d8-9eb4-bbccfa4aa479 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:10.055668 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 526/1048] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:11.058426 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f39-9aa8-4e63-850a-592beb7dfe50 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:11.059039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f39-9aa8-4e63-850a-592beb7dfe50 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:11.059039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8f39-9aa8-4e63-850a-592beb7dfe50 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:11.060474 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:11.066570 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684f4-22db-4515-908d-2baa900f358a None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:11.067141 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684f4-22db-4515-908d-2baa900f358a None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:11.067320 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35684f4-22db-4515-908d-2baa900f358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:11.092582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d35684f4-22db-4515-908d-2baa900f358a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:11.093856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d35684f4-22db-4515-908d-2baa900f358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:11.105068 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:11.269467 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8f39-9aa8-4e63-850a-592beb7dfe50 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:11.283710 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8f39-9aa8-4e63-850a-592beb7dfe50 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:11.288917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f835ad-927e-4b04-9978-8666890101de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:11.289836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f835ad-927e-4b04-9978-8666890101de service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:11.290254 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f835ad-927e-4b04-9978-8666890101de service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:11.290529 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f835ad-927e-4b04-9978-8666890101de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:11.299901 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f835ad-927e-4b04-9978-8666890101de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:11.301503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f835ad-927e-4b04-9978-8666890101de service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:11.313537 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 524/1051] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:12.234248 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b64c-5beb-45bb-9d23-ba248401fb06 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:12.235070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b64c-5beb-45bb-9d23-ba248401fb06 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:12.235479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b64c-5beb-45bb-9d23-ba248401fb06 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:12.237943 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:12.244301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365da0-8f80-41b3-8d93-b42ec49e0163 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:12.244907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365da0-8f80-41b3-8d93-b42ec49e0163 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:12.244907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365da0-8f80-41b3-8d93-b42ec49e0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:12.266018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-61365da0-8f80-41b3-8d93-b42ec49e0163 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:12.267309 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-61365da0-8f80-41b3-8d93-b42ec49e0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:12.275567 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:12.433303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b64c-5beb-45bb-9d23-ba248401fb06 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:12.447296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b64c-5beb-45bb-9d23-ba248401fb06 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:12.452987 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807be636-e171-414f-869c-20f863e7649c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:12.453648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807be636-e171-414f-869c-20f863e7649c service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:12.453963 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807be636-e171-414f-869c-20f863e7649c service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:12.454316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807be636-e171-414f-869c-20f863e7649c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:12.464004 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807be636-e171-414f-869c-20f863e7649c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:12.468469 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807be636-e171-414f-869c-20f863e7649c service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:12.476444 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 529/1054] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:27:13.456541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15886-ea59-4ebb-9f83-c626bdc9b97c None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:13.457131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15886-ea59-4ebb-9f83-c626bdc9b97c None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:13.457131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15886-ea59-4ebb-9f83-c626bdc9b97c None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:13.458452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:27:13.465265 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a9e2-9dec-4a17-9ccb-34e576529592 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:13.465865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a9e2-9dec-4a17-9ccb-34e576529592 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:13.465865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a9e2-9dec-4a17-9ccb-34e576529592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:13.488263 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-c0f5a9e2-9dec-4a17-9ccb-34e576529592 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:13.489539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-c0f5a9e2-9dec-4a17-9ccb-34e576529592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:13.498415 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:27:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:13.658138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15886-ea59-4ebb-9f83-c626bdc9b97c None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:13.673568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15886-ea59-4ebb-9f83-c626bdc9b97c None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:13.678694 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:13.679319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:13.679629 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:13.680524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:13.690270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:13.691936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f76a13-65fb-48f0-b676-5b1d3bf649c2 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:13.704717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 527/1057] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:15.966707 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8e6a-07fb-492b-a421-67b94296f9c1 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:15.967275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8e6a-07fb-492b-a421-67b94296f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:15.967275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff8e6a-07fb-492b-a421-67b94296f9c1 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:15.968560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:27:15.979005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790d89-ec1e-4e80-ae36-f8e7ac789ac5 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:15.979622 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790d89-ec1e-4e80-ae36-f8e7ac789ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:15.979997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54790d89-ec1e-4e80-ae36-f8e7ac789ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:16.014253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-54790d89-ec1e-4e80-ae36-f8e7ac789ac5 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:16.016402 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-54790d89-ec1e-4e80-ae36-f8e7ac789ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:16.031120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:16.401551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff8e6a-07fb-492b-a421-67b94296f9c1 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:16.412853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff8e6a-07fb-492b-a421-67b94296f9c1 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:16.417313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:16.417922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:16.418200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:16.418469 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:16.428210 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:16.429646 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636790f9-43da-43fb-9077-411a2e82a739 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:16.439830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 532/1060] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:19.599445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874be09-2eb6-4ff3-bf5c-8570663d4ca1 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:19.600060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874be09-2eb6-4ff3-bf5c-8570663d4ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:19.600060 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874be09-2eb6-4ff3-bf5c-8570663d4ca1 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:19.601392 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:19.607659 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcfaf-f219-4b71-8d1d-6f27438347f3 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:19.608465 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcfaf-f219-4b71-8d1d-6f27438347f3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:19.608669 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dcfaf-f219-4b71-8d1d-6f27438347f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:19.629311 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-198dcfaf-f219-4b71-8d1d-6f27438347f3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:19.634638 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-198dcfaf-f219-4b71-8d1d-6f27438347f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:19.639599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:19.985654 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874be09-2eb6-4ff3-bf5c-8570663d4ca1 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:19.997660 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874be09-2eb6-4ff3-bf5c-8570663d4ca1 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:20.001338 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:20.001964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:20.002259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:20.002524 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:20.012915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:20.014356 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed72fe3-6c0e-4d72-9379-38a0b8b099fe service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:20.025322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 530/1063] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:22.750579 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b334-244b-498b-8f7b-28507cb20071 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:22.751135 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b334-244b-498b-8f7b-28507cb20071 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:22.751135 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1b334-244b-498b-8f7b-28507cb20071 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:22.752480 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:22.758899 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b46a-3a28-4cbc-8983-e1deaa30a3c6 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:22.759380 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b46a-3a28-4cbc-8983-e1deaa30a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:22.759891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b46a-3a28-4cbc-8983-e1deaa30a3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:22.790621 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5165b46a-3a28-4cbc-8983-e1deaa30a3c6 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:22.792653 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5165b46a-3a28-4cbc-8983-e1deaa30a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:22.806145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:23.151498 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1b334-244b-498b-8f7b-28507cb20071 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:23.162302 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1b334-244b-498b-8f7b-28507cb20071 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:23.166679 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:23.167283 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:23.167586 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:23.167855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:23.177702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:23.179176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53d899-a9d4-4472-8656-1b8a38fd6480 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:23.190189 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 535/1066] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:25.529297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f7d-c725-49c5-8513-43123c4b0f8e None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:25.529850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f7d-c725-49c5-8513-43123c4b0f8e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:25.529850 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f7d-c725-49c5-8513-43123c4b0f8e None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:25.531102 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:25.536688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b3439-70e7-4f9d-a4a0-ccec058a2110 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:25.537143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b3439-70e7-4f9d-a4a0-ccec058a2110 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:25.537258 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b3439-70e7-4f9d-a4a0-ccec058a2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:25.557093 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d40b3439-70e7-4f9d-a4a0-ccec058a2110 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:25.558288 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d40b3439-70e7-4f9d-a4a0-ccec058a2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:25.566349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:25.911138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445f7d-c725-49c5-8513-43123c4b0f8e None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:25.922044 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445f7d-c725-49c5-8513-43123c4b0f8e None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:25.925541 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:25.926136 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:25.926409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:25.926672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:25.936334 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:25.937751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8aacc2-a1b0-4cdf-963c-1f2749c7b287 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:25.947953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 533/1069] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:28.214925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814890f-ca29-484e-a9f3-cc6ceed6b271 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:28.215601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814890f-ca29-484e-a9f3-cc6ceed6b271 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:28.215601 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814890f-ca29-484e-a9f3-cc6ceed6b271 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:28.216833 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:28.222600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0edfd3-66b8-4ceb-8264-871a3bae6b7f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:28.223070 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0edfd3-66b8-4ceb-8264-871a3bae6b7f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:28.223163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0edfd3-66b8-4ceb-8264-871a3bae6b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:28.242568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-df0edfd3-66b8-4ceb-8264-871a3bae6b7f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:28.243944 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-df0edfd3-66b8-4ceb-8264-871a3bae6b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:28.252238 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:28.598897 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814890f-ca29-484e-a9f3-cc6ceed6b271 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:28.611463 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814890f-ca29-484e-a9f3-cc6ceed6b271 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:28.615053 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:28.615754 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:28.626405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:28.626405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:28.626734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:28.628200 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59806b3-19a0-474d-8968-de2a151cf9f7 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:28.639626 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 538/1072] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:30.950926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591b0a-0b71-4a78-b732-0672ced6c727 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:30.950926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591b0a-0b71-4a78-b732-0672ced6c727 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:30.950926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c591b0a-0b71-4a78-b732-0672ced6c727 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:30.950926 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:30.951741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219578d0-2916-4f7e-9106-62200b84cdc9 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:30.951741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219578d0-2916-4f7e-9106-62200b84cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:30.952179 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219578d0-2916-4f7e-9106-62200b84cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:30.959313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=70 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:30.972950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-219578d0-2916-4f7e-9106-62200b84cdc9 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:30.974175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-219578d0-2916-4f7e-9106-62200b84cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:30.984221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:31.331023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591b0a-0b71-4a78-b732-0672ced6c727 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:31.337443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=64 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:31.343739 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c591b0a-0b71-4a78-b732-0672ced6c727 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:31.347561 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:31.348170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:31.348486 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:31.348721 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:31.359724 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:31.361439 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed830f-3f40-4f94-aeee-9c5c8c614162 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:31.371766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 536/1075] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:33.653114 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fded-33e8-4811-9ac7-0c03c4898009 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.653787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fded-33e8-4811-9ac7-0c03c4898009 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.653787 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247fded-33e8-4811-9ac7-0c03c4898009 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.654975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:27:33.660798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf82646-b10a-4e02-9b8f-9e78bf29ed9f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:33.662364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf82646-b10a-4e02-9b8f-9e78bf29ed9f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:33.662364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf82646-b10a-4e02-9b8f-9e78bf29ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:33.683239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-fdf82646-b10a-4e02-9b8f-9e78bf29ed9f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:33.684520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-fdf82646-b10a-4e02-9b8f-9e78bf29ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:33.693054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:34.036989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247fded-33e8-4811-9ac7-0c03c4898009 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:34.049307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247fded-33e8-4811-9ac7-0c03c4898009 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:34.052832 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:34.053430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:34.053703 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:34.054050 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:34.064445 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:34.065993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd123b7-1dd5-494a-b5ba-4e9ed5f8efa7 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:34.076967 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 541/1078] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:36.372578 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b134-d9f3-4c15-aed8-2045ab45ee91 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.373141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b134-d9f3-4c15-aed8-2045ab45ee91 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.373141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b134-d9f3-4c15-aed8-2045ab45ee91 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.374472 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:36.380025 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80d79-8d47-4695-a060-0be07fd5b721 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.380488 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80d79-8d47-4695-a060-0be07fd5b721 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.380591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce80d79-8d47-4695-a060-0be07fd5b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.399473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9ce80d79-8d47-4695-a060-0be07fd5b721 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:36.400695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9ce80d79-8d47-4695-a060-0be07fd5b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:36.408361 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:36.750487 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b134-d9f3-4c15-aed8-2045ab45ee91 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:36.762304 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b134-d9f3-4c15-aed8-2045ab45ee91 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.766072 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.766665 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.766957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.767222 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.777119 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.778566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a7890-cab4-464b-8ccf-e624bc098f23 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.788529 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 539/1081] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:39.054226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f298-8c5e-4919-9373-0f33cba3eebb None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.054805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f298-8c5e-4919-9373-0f33cba3eebb None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.054805 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8f298-8c5e-4919-9373-0f33cba3eebb None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.056316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:39.062497 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70767d2-bde4-4433-a28e-41321e108716 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.063039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70767d2-bde4-4433-a28e-41321e108716 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.063039 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70767d2-bde4-4433-a28e-41321e108716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.082800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d70767d2-bde4-4433-a28e-41321e108716 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:39.084056 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d70767d2-bde4-4433-a28e-41321e108716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:39.092801 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:39.439863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8f298-8c5e-4919-9373-0f33cba3eebb None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:39.451599 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8f298-8c5e-4919-9373-0f33cba3eebb None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:39.455129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:39.455780 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:39.456050 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:39.456316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:39.467298 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:39.468786 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4fe3e-c389-4f21-93e3-bdccaaa1fc31 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:39.480174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 544/1084] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:41.713261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db52f-8ce8-4b35-8184-f04c998f4bbb None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.713835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db52f-8ce8-4b35-8184-f04c998f4bbb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.713835 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db52f-8ce8-4b35-8184-f04c998f4bbb None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.715129 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:41.720550 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e76a0-28dc-46f8-ba53-6bbf65427350 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:41.720981 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e76a0-28dc-46f8-ba53-6bbf65427350 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:41.721088 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e76a0-28dc-46f8-ba53-6bbf65427350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:41.740448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-e51e76a0-28dc-46f8-ba53-6bbf65427350 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:41.741628 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e51e76a0-28dc-46f8-ba53-6bbf65427350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:41.750424 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:27:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:42.110447 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db52f-8ce8-4b35-8184-f04c998f4bbb None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:42.121559 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db52f-8ce8-4b35-8184-f04c998f4bbb None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:42.125046 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:42.125632 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:42.125906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:42.126174 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:42.135717 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:42.137141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956468-b7be-4ca2-96ce-4c7840f317e4 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:42.146800 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 542/1087] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:51.735559 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=20 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:52.142483 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=23 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:07.785830 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f54ba-e1cc-444f-b910-27ce84af394e None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.786484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f54ba-e1cc-444f-b910-27ce84af394e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.786484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f54ba-e1cc-444f-b910-27ce84af394e None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.787813 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 546/1088] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:07.794652 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1957-bcf5-42ba-8fe1-8a4a4f2cdd5f None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:07.795284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1957-bcf5-42ba-8fe1-8a4a4f2cdd5f None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:07.795284 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d1957-bcf5-42ba-8fe1-8a4a4f2cdd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:07.817023 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-713d1957-bcf5-42ba-8fe1-8a4a4f2cdd5f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:07.831606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-713d1957-bcf5-42ba-8fe1-8a4a4f2cdd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:07.831606 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 543/1089] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:08.201175 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a762ac-24c8-4f21-a1e5-ca24cd5b3f79 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:08.201593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a762ac-24c8-4f21-a1e5-ca24cd5b3f79 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:08.201846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a762ac-24c8-4f21-a1e5-ca24cd5b3f79 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:08.203020 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 547/1090] 10.222.0.50 () {54 vars in 967 bytes} [Tue Aug 23 22:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:28:08.209285 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bd659-59e7-4971-a645-c14a8c7591d2 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:08.209617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bd659-59e7-4971-a645-c14a8c7591d2 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:08.209936 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bd659-59e7-4971-a645-c14a8c7591d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:08.233301 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-df9bd659-59e7-4971-a645-c14a8c7591d2 None None] MFA Rules not processed for user `6f428da0321f49fa81fa70bcdddeaf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:08.234588 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-df9bd659-59e7-4971-a645-c14a8c7591d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:08.241814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 544/1091] 10.222.0.50 () {58 vars in 1064 bytes} [Tue Aug 23 22:28:08 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:08.250962 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a762ac-24c8-4f21-a1e5-ca24cd5b3f79 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:08.263801 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a762ac-24c8-4f21-a1e5-ca24cd5b3f79 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:08.267407 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f428da0321f49fa81fa70bcdddeaf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:08.268109 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:08.268379 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:08.268651 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:08.280421 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:08.281949 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472640e-cc06-40f9-ad8a-7c04310d076a service glance] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:08.294009 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 548/1092] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:10.710194 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4f2c-0f1e-4188-aa71-c851b254888e None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.710875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4f2c-0f1e-4188-aa71-c851b254888e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.711143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4f2c-0f1e-4188-aa71-c851b254888e None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.714545 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 545/1093] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:10.720699 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3176b7-652c-4703-84ab-46e216549619 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.721291 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3176b7-652c-4703-84ab-46e216549619 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.721291 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3176b7-652c-4703-84ab-46e216549619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.743069 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-fc3176b7-652c-4703-84ab-46e216549619 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:10.746285 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fc3176b7-652c-4703-84ab-46e216549619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:10.752712 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 549/1094] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:11.098073 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4f2c-0f1e-4188-aa71-c851b254888e None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:11.116656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4f2c-0f1e-4188-aa71-c851b254888e None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:11.124457 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:11.125491 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:11.125983 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:11.126471 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:11.127695 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:11.130970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:28:11.130970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:28:11.130970 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:28:11.133306 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087e29-deee-4275-aa43-a0aa8aa04d8a admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:11.170297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 546/1095] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Aug 23 22:28:11 2022] GET /identity/v3/projects => generated 1606 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:13.606986 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2627-ed82-4d4c-80a9-8042efa1df9e None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:13.607618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2627-ed82-4d4c-80a9-8042efa1df9e None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:13.607618 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e2627-ed82-4d4c-80a9-8042efa1df9e None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:13.609168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 550/1096] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:13.615868 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26b9d-8306-4a9b-8b9c-445f883cea16 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:13.617250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26b9d-8306-4a9b-8b9c-445f883cea16 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:13.617250 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf26b9d-8306-4a9b-8b9c-445f883cea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:13.638875 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-cbf26b9d-8306-4a9b-8b9c-445f883cea16 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:13.640150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-cbf26b9d-8306-4a9b-8b9c-445f883cea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:13.648112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 547/1097] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:14.004291 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e2627-ed82-4d4c-80a9-8042efa1df9e None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:14.019769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e2627-ed82-4d4c-80a9-8042efa1df9e None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:14.024815 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:14.026194 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:14.031446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:14.031446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:14.036736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:14.038388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eed57d-e56c-4ffd-b5ef-e97db5f53443 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:14.050759 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 551/1098] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:16.509273 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2944ba-3f14-4e69-b3d3-35e65091b5cc None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:16.509802 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2944ba-3f14-4e69-b3d3-35e65091b5cc None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:16.509802 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2944ba-3f14-4e69-b3d3-35e65091b5cc None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:16.511836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 548/1099] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:28:16.518303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff05-04df-4fe2-bb10-5b397e867da4 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:16.518851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff05-04df-4fe2-bb10-5b397e867da4 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:16.518851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437ff05-04df-4fe2-bb10-5b397e867da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:16.540782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-4437ff05-04df-4fe2-bb10-5b397e867da4 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:16.542556 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-4437ff05-04df-4fe2-bb10-5b397e867da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:16.550492 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 552/1100] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:16.897122 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2944ba-3f14-4e69-b3d3-35e65091b5cc None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:16.910359 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2944ba-3f14-4e69-b3d3-35e65091b5cc None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:16.914599 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:16.915203 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:16.915478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:16.915779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:16.927634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:16.929292 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87de9c8-f821-423f-86e6-9ae82f31a727 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:16.939296 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 549/1101] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:19.249082 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292f36-c68c-4f0c-8c1a-4d65cdc5ef75 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:19.249856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292f36-c68c-4f0c-8c1a-4d65cdc5ef75 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:19.249856 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292f36-c68c-4f0c-8c1a-4d65cdc5ef75 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:19.251454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 553/1102] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:19.257195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999aac-6b0f-4b09-ad9d-c0a6bf2e6e17 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:19.257656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999aac-6b0f-4b09-ad9d-c0a6bf2e6e17 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:19.257763 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48999aac-6b0f-4b09-ad9d-c0a6bf2e6e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:19.277890 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-48999aac-6b0f-4b09-ad9d-c0a6bf2e6e17 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:19.279105 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-48999aac-6b0f-4b09-ad9d-c0a6bf2e6e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:19.287010 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 550/1103] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:19.642104 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c292f36-c68c-4f0c-8c1a-4d65cdc5ef75 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:19.653886 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c292f36-c68c-4f0c-8c1a-4d65cdc5ef75 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:19.658452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:19.659350 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:19.659821 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:19.660233 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:19.671277 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:19.672757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b1bf-9b79-4121-8085-24ca5f7e67d1 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:19.683395 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 554/1104] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:22.172548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a103a-bfd5-4aa2-9c30-311f49b55cce None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.173090 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a103a-bfd5-4aa2-9c30-311f49b55cce None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.173219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a103a-bfd5-4aa2-9c30-311f49b55cce None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.174774 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 551/1105] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:22.180789 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e16c5-4865-4c50-97fc-b339e9e14596 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.181240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e16c5-4865-4c50-97fc-b339e9e14596 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.181402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e16c5-4865-4c50-97fc-b339e9e14596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.205134 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-989e16c5-4865-4c50-97fc-b339e9e14596 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:22.206362 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-989e16c5-4865-4c50-97fc-b339e9e14596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:22.215070 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 555/1106] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:22.578798 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a103a-bfd5-4aa2-9c30-311f49b55cce None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:22.590427 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a103a-bfd5-4aa2-9c30-311f49b55cce None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:22.594197 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:22.594852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.595132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.595435 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.605905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:22.607448 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ea6c1-96a0-4018-b890-3c6ee5973d5d service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:22.619461 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 552/1107] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:25.401850 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d97-3eb0-487c-b935-8b0bd7a15d54 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:25.402530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d97-3eb0-487c-b935-8b0bd7a15d54 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:25.402530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3d97-3eb0-487c-b935-8b0bd7a15d54 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:25.403803 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 556/1108] 10.222.0.50 () {54 vars in 927 bytes} [Tue Aug 23 22:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:25.409958 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c3b8-f7e8-4bb8-80e0-4dfc90de1060 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:25.410480 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c3b8-f7e8-4bb8-80e0-4dfc90de1060 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:25.410662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c3b8-f7e8-4bb8-80e0-4dfc90de1060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:25.431753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-39f7c3b8-f7e8-4bb8-80e0-4dfc90de1060 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:25.433852 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-39f7c3b8-f7e8-4bb8-80e0-4dfc90de1060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:25.442055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 553/1109] 10.222.0.50 () {58 vars in 1024 bytes} [Tue Aug 23 22:28:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:25.792788 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3d97-3eb0-487c-b935-8b0bd7a15d54 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:25.804346 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3d97-3eb0-487c-b935-8b0bd7a15d54 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:25.808169 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:25.808781 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:25.809054 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:25.809330 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:25.819093 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:25.820594 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67038b5-f036-4b7d-96ea-28d1594bceba service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:25.832905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 557/1110] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:35.426664 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=33 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:35.827296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=33 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:01.919247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:01.919247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:01.919247 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:01.940595 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:01.941824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:01.949822 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 554/1111] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:30:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:01.958385 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:01.959003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:01.959003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:01.979144 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:01.980972 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:01.990187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 558/1112] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:30:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:01.995178 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.006257 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d3cc-dad0-4f9e-8a1c-bba30e9a6027 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.010963 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.011619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.011902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.012175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.012836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:30:02.013134 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.014741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.014741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:30:02.014741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:30:02.016057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.028564 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 555/1113] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Aug 23 22:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:30:02.037866 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.048785 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd4b5-1bde-4d32-ae84-ab6a79df77be None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.053584 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.054223 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.054502 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.054766 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.055392 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.057174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.057174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:30:02.057174 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:30:02.058368 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.200760 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 559/1114] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Aug 23 22:30:02 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:02.205566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.216093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701224d1-a840-4f52-b601-476089daebe9 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.273620 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.274219 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.274495 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.274813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.275546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.276530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.276530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:30:02.276530 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:30:02.277818 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.382245 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 556/1115] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:30:02 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:30:02.386526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.398098 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c62df-236b-4ad4-82a0-75fea87fac4b admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.402684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.403322 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.403629 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.403898 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.404546 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.405551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.405551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:30:02.405551 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:30:02.407173 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.421032 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 560/1116] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:30:02.425278 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.435478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6fb8-fc4d-4211-8a72-f588b96e2864 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.441075 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.441675 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.441955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.442225 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.442907 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.443953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.443953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:30:02.443953 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:30:02.445033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4ec67-50be-46e9-b733-a539d496c0d4 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.460703 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 557/1117] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:30:02.464955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.475631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b827b4-afab-44d3-aed9-ee886316a48d admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.480457 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.481111 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.481390 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.481661 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] PATH_INFO: `/v3/projects/56b2b1651fcb4cb19289066e81019724/users/2359e1358ba542089ca52efa87fcbef7/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.497528 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b2b1651fcb4cb19289066e81019724, user_id=2359e1358ba542089ca52efa87fcbef7, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.499273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.499273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:30:02.499273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:30:02.501316 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb0d1f-4caf-4228-9a20-3cf50fc61284 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.593602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 561/1118] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:30:02 2022] PUT /identity/v3/projects/56b2b1651fcb4cb19289066e81019724/users/2359e1358ba542089ca52efa87fcbef7/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:02.605709 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548c638-57e9-4e62-91fa-c19108fba40e None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.605990 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548c638-57e9-4e62-91fa-c19108fba40e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.606255 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548c638-57e9-4e62-91fa-c19108fba40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.636300 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5548c638-57e9-4e62-91fa-c19108fba40e None None] MFA Rules not processed for user `2359e1358ba542089ca52efa87fcbef7`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:02.637531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5548c638-57e9-4e62-91fa-c19108fba40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:02.705239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 558/1119] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:30:02 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:02.719154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe41ff-ab66-4294-a980-1ac01aae6b90 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.719429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe41ff-ab66-4294-a980-1ac01aae6b90 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.719751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe41ff-ab66-4294-a980-1ac01aae6b90 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.721278 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 562/1120] 10.222.0.50 () {54 vars in 964 bytes} [Tue Aug 23 22:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:30:02.726196 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337f34-e684-483a-ac4f-13a97b74af01 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.726483 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337f34-e684-483a-ac4f-13a97b74af01 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.726762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337f34-e684-483a-ac4f-13a97b74af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.747001 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-34337f34-e684-483a-ac4f-13a97b74af01 None None] MFA Rules not processed for user `3b13ed7288ab43e08f7b842927e77d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:02.748326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-34337f34-e684-483a-ac4f-13a97b74af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:02.791546 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:02.800097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 559/1121] 10.222.0.50 () {58 vars in 1061 bytes} [Tue Aug 23 22:30:02 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:02.807863 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe41ff-ab66-4294-a980-1ac01aae6b90 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.819161 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe41ff-ab66-4294-a980-1ac01aae6b90 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.822695 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b13ed7288ab43e08f7b842927e77d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.823275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.823583 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.823853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.833768 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.835346 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:02.846157 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 563/1122] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:02 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:02.886027 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fefc7-ea69-4801-adf8-dc1023fc7e6e None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.886315 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fefc7-ea69-4801-adf8-dc1023fc7e6e None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.886593 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fefc7-ea69-4801-adf8-dc1023fc7e6e None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.887906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 560/1123] 10.222.0.50 () {52 vars in 830 bytes} [Tue Aug 23 22:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:30:02.892066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:02.957376 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a461-58e0-4170-9bd3-fdc4691e3c74 service cinder] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:02.962089 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:02.962688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:02.962926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:02.963198 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] PATH_INFO: `/v3/users/2359e1358ba542089ca52efa87fcbef7` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:02.964372 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2359e1358ba542089ca52efa87fcbef7)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:02.965394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:02.965394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:30:02.965394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:30:02.966602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:03.394582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2359e1358ba542089ca52efa87fcbef7'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.395687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2359e1358ba542089ca52efa87fcbef7'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.445892 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2359e1358ba542089ca52efa87fcbef7'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.474238 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2359e1358ba542089ca52efa87fcbef7'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.485272 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:03.489656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2359e1358ba542089ca52efa87fcbef7'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:03.496031 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 564/1124] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:02 2022] DELETE /identity/v3/users/2359e1358ba542089ca52efa87fcbef7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:03.501437 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.501954 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.502051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:03.521258 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:03.522475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.584520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 561/1125] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:30:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:03.594849 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:03.596405 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.658594 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2030382-f28b-46ea-977c-02824048230b admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:03.662203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:03.663012 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.663187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.663460 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:03.674042 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:03.675526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef51ed-56e0-4601-af7c-5d95dd2209be service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:03.685534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 565/1126] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:04.254600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:04.256226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:04.268859 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc723d-9a76-44d2-8a8c-c12100ba624a None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:04.274793 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:04.275390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] PATH_INFO: `/v3/projects/56b2b1651fcb4cb19289066e81019724` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b2b1651fcb4cb19289066e81019724)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:30:04.280938 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:04.437286 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b2b1651fcb4cb19289066e81019724', 'request_id': 'req-7415ccb8-eb15-4592-8c81-f57b8893943c'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:04.443952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b2b1651fcb4cb19289066e81019724', 'request_id': 'req-7415ccb8-eb15-4592-8c81-f57b8893943c'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:04.458792 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b2b1651fcb4cb19289066e81019724', 'request_id': 'req-7415ccb8-eb15-4592-8c81-f57b8893943c'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:04.532759 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] The token cache is being invalidate because project 56b2b1651fcb4cb19289066e81019724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:04.533443 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:04.533698 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-7415ccb8-eb15-4592-8c81-f57b8893943c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:04.535609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 562/1127] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:04 2022] DELETE /identity/v3/projects/56b2b1651fcb4cb19289066e81019724 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:13.681244 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=29 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:14.528515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:29.353855 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:29.354450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:29.354450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:29.355816 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:31:29.360808 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504173a-4385-4c8d-96e8-1f49f528a1e3 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:29.361240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504173a-4385-4c8d-96e8-1f49f528a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:29.361366 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504173a-4385-4c8d-96e8-1f49f528a1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:29.383892 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-4504173a-4385-4c8d-96e8-1f49f528a1e3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:29.385446 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4504173a-4385-4c8d-96e8-1f49f528a1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:29.447210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:29.606443 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:29.608135 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:29.679774 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fae04-14e9-42ea-a8c9-a6177c20f083 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:29.684744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405323f-3226-4343-8138-be5252590319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:29.685386 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405323f-3226-4343-8138-be5252590319 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:29.685661 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405323f-3226-4343-8138-be5252590319 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:29.685931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405323f-3226-4343-8138-be5252590319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:29.694483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405323f-3226-4343-8138-be5252590319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:29.696125 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405323f-3226-4343-8138-be5252590319 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:29.705993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 567/1130] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:30.555919 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066d0-aa6d-4bb9-bc93-80c105ddc311 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:30.556503 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066d0-aa6d-4bb9-bc93-80c105ddc311 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:30.556603 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066d0-aa6d-4bb9-bc93-80c105ddc311 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:30.557927 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:30.562809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d577b-76c3-4e2d-a130-948fadb79e3f None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:30.566048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d577b-76c3-4e2d-a130-948fadb79e3f None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:30.566048 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d577b-76c3-4e2d-a130-948fadb79e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:30.583633 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a21d577b-76c3-4e2d-a130-948fadb79e3f None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:30.584828 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a21d577b-76c3-4e2d-a130-948fadb79e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:30.592735 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:30.753514 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4066d0-aa6d-4bb9-bc93-80c105ddc311 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:30.766779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4066d0-aa6d-4bb9-bc93-80c105ddc311 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:30.772636 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:30.773227 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:30.773500 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:30.773768 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:30.782252 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:30.784406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13f75-c679-4b39-85ef-ac68c09e3f89 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:30.794751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 565/1133] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:35.423736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881ea1f-9eb2-4bbf-b94a-35ba8b892379 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:35.424275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881ea1f-9eb2-4bbf-b94a-35ba8b892379 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:35.424275 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881ea1f-9eb2-4bbf-b94a-35ba8b892379 None None] PATH_INFO: `/v3` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:35.426123 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 569/1134] 10.222.0.65 () {54 vars in 925 bytes} [Tue Aug 23 22:31:35 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:31:35.432639 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb303-3966-410d-8b81-10f3fc2503e9 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:35.433093 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb303-3966-410d-8b81-10f3fc2503e9 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:35.433189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb303-3966-410d-8b81-10f3fc2503e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:35.452902 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-364cb303-3966-410d-8b81-10f3fc2503e9 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:35.454120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-364cb303-3966-410d-8b81-10f3fc2503e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:35.525364 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 566/1135] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 23 22:31:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:40.578868 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=35 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:42.016409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae409-bc44-4115-a7cb-75e7b28d2618 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:42.017039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae409-bc44-4115-a7cb-75e7b28d2618 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:42.017039 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae409-bc44-4115-a7cb-75e7b28d2618 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:42.018560 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:42.023842 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44edd-b1f4-4d48-ba5b-4fe24ca56416 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:42.024294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44edd-b1f4-4d48-ba5b-4fe24ca56416 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:42.024412 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded44edd-b1f4-4d48-ba5b-4fe24ca56416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:42.044609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-ded44edd-b1f4-4d48-ba5b-4fe24ca56416 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:42.045815 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-ded44edd-b1f4-4d48-ba5b-4fe24ca56416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:42.054345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:42.212367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ae409-bc44-4115-a7cb-75e7b28d2618 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:42.226922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ae409-bc44-4115-a7cb-75e7b28d2618 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:42.236413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:42.236413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:42.236413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:42.236413 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:42.242819 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:42.244441 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349e0b1-8636-4e93-bfab-8f2e996a37c8 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:42.255349 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 571/1138] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:43.099506 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114dcef-b5d5-43cb-a929-a3b72ff38f04 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:43.100106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114dcef-b5d5-43cb-a929-a3b72ff38f04 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:43.100106 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114dcef-b5d5-43cb-a929-a3b72ff38f04 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:43.101408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:43.106495 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c445c-b3dd-44eb-838e-13ad51f16937 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:43.106926 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c445c-b3dd-44eb-838e-13ad51f16937 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:43.107043 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c445c-b3dd-44eb-838e-13ad51f16937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:43.126950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-925c445c-b3dd-44eb-838e-13ad51f16937 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:43.128213 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-925c445c-b3dd-44eb-838e-13ad51f16937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:43.136081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:43.295797 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114dcef-b5d5-43cb-a929-a3b72ff38f04 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:43.310170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114dcef-b5d5-43cb-a929-a3b72ff38f04 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:43.315217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:43.315883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:43.316154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:43.316629 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:43.326445 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:43.328114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13adf75-3a95-4874-8ad0-af8e4f58a963 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:43.339131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 569/1141] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:45.213371 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ade2fd-b73b-4642-9648-b6a5f708e681 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:45.213944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ade2fd-b73b-4642-9648-b6a5f708e681 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:45.213944 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ade2fd-b73b-4642-9648-b6a5f708e681 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:45.215249 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 573/1142] 10.222.0.50 () {54 vars in 961 bytes} [Tue Aug 23 22:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:45.220484 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1e40-cb7b-4f33-b009-5f6bbd5cc150 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:45.229297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1e40-cb7b-4f33-b009-5f6bbd5cc150 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:45.229297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1e40-cb7b-4f33-b009-5f6bbd5cc150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:45.241552 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-d68f1e40-cb7b-4f33-b009-5f6bbd5cc150 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:45.243026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d68f1e40-cb7b-4f33-b009-5f6bbd5cc150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:45.252294 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 570/1143] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Aug 23 22:31:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:45.260187 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ade2fd-b73b-4642-9648-b6a5f708e681 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:45.274533 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ade2fd-b73b-4642-9648-b6a5f708e681 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:45.279613 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:45.280206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:45.280481 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:45.280745 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:45.290154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:45.292203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c25fe1-853b-4206-a3e7-cfcd1788176a service placement] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:45.302972 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 574/1144] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:54.557022 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570162b-87ec-4a1d-abe6-16efcefbe7cc None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:54.557657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570162b-87ec-4a1d-abe6-16efcefbe7cc None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:54.557657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570162b-87ec-4a1d-abe6-16efcefbe7cc None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:54.558940 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:31:54.566246 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bae53-58d9-40f9-abd0-03c714be3ec0 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:54.566860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bae53-58d9-40f9-abd0-03c714be3ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:54.566860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bae53-58d9-40f9-abd0-03c714be3ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:54.587143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-824bae53-58d9-40f9-abd0-03c714be3ec0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:54.588373 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-824bae53-58d9-40f9-abd0-03c714be3ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:54.596317 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:54.760608 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570162b-87ec-4a1d-abe6-16efcefbe7cc None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:54.768163 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=75 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:54.775180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570162b-87ec-4a1d-abe6-16efcefbe7cc None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:54.780369 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:54.780979 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:54.781266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:54.781542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:54.790802 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:54.792513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488ae6-3462-47c8-b6b9-2788bcc173e8 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:54.802690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 572/1147] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:55.630799 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49dd6f-37e5-4f69-894c-53209c7397f2 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.631340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49dd6f-37e5-4f69-894c-53209c7397f2 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.631340 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49dd6f-37e5-4f69-894c-53209c7397f2 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.632827 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:31:55.637841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abe87-dd6f-45ae-9e38-7865b7cd82e1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.638274 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abe87-dd6f-45ae-9e38-7865b7cd82e1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.638382 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abe87-dd6f-45ae-9e38-7865b7cd82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.657673 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-5b9abe87-dd6f-45ae-9e38-7865b7cd82e1 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:55.658871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-5b9abe87-dd6f-45ae-9e38-7865b7cd82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:55.668774 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:31:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:55.828033 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49dd6f-37e5-4f69-894c-53209c7397f2 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.843133 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49dd6f-37e5-4f69-894c-53209c7397f2 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.848933 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.849534 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.849809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.850080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.858289 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.859904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f77c5-64bd-4d5a-a692-8d82232cd9ea service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.869475 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 577/1150] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:00.253647 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:00.254753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:00.254753 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:00.256179 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:32:00.261596 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb409f-0660-40d2-a15c-e7c34b02a964 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:00.262033 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb409f-0660-40d2-a15c-e7c34b02a964 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:00.262129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb409f-0660-40d2-a15c-e7c34b02a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:00.281484 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-62eb409f-0660-40d2-a15c-e7c34b02a964 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:00.282611 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-62eb409f-0660-40d2-a15c-e7c34b02a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:00.290850 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:32:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:00.643867 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:00.647160 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:00.708663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae59b9-2f0d-46c0-8429-d161f6593979 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:00.712193 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:00.712785 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:00.713055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:00.713337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:00.722236 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:00.723713 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce684e-711f-43bb-a980-8dabc43a3dd0 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:00.733018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 575/1153] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:02.989433 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc5c2-70ce-42c3-bb94-7745b032c569 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:02.989966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc5c2-70ce-42c3-bb94-7745b032c569 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:02.989966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadc5c2-70ce-42c3-bb94-7745b032c569 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:02.991304 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:32:02.996876 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b2ff-5860-4f4e-bd09-c16f4e6e7e3c None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:02.997384 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b2ff-5860-4f4e-bd09-c16f4e6e7e3c None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:02.997384 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b2ff-5860-4f4e-bd09-c16f4e6e7e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.017708 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-3b91b2ff-5860-4f4e-bd09-c16f4e6e7e3c None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:03.018933 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-3b91b2ff-5860-4f4e-bd09-c16f4e6e7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:03.026996 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:32:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:03.369479 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadc5c2-70ce-42c3-bb94-7745b032c569 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.381572 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadc5c2-70ce-42c3-bb94-7745b032c569 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.385154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.385753 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.386032 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.386307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.395915 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.397346 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472daa1-02f6-4846-acd1-ab27198b8ddf service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:03.406995 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 580/1156] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:07.293924 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:07.294507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:07.294507 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:07.295825 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 577/1157] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:32:07.301761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35a02-29ba-4d15-9f17-64165afb52c3 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:07.302232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35a02-29ba-4d15-9f17-64165afb52c3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:07.302339 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f35a02-29ba-4d15-9f17-64165afb52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:07.322721 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-b3f35a02-29ba-4d15-9f17-64165afb52c3 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:07.323966 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-b3f35a02-29ba-4d15-9f17-64165afb52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:07.331723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 581/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:32:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:07.907266 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:07.909088 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:07.972767 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b3866-dc3b-4934-b635-d9439e84b2f8 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:07.976858 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b13ed7288ab43e08f7b842927e77d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:07.977477 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:07.977751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:07.978016 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:07.987988 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:07.990038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff57fb9-10a7-4568-a608-70f81a4048af service cinder] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:08.000723 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 578/1159] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:10.235702 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.236800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.236800 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.237564 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 582/1160] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:32:10.243065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb6d2-d012-41a7-83bf-6329949723c0 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.243575 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb6d2-d012-41a7-83bf-6329949723c0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.243678 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb6d2-d012-41a7-83bf-6329949723c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.264168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-058cb6d2-d012-41a7-83bf-6329949723c0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:10.265390 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-058cb6d2-d012-41a7-83bf-6329949723c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:10.274120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 579/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:32:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:10.848929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:10.850641 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:10.858328 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=37 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:10.864904 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d37f23-ad86-418e-ad45-34bc3cdffa47 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:10.868489 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b13ed7288ab43e08f7b842927e77d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:10.872595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.872595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.872595 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.878840 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:10.881237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb5e21-6dcd-4edd-80e8-5bcc23ad8387 service cinder] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:10.891515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 583/1162] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:20.259394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=66 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:20.902419 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=5 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:26.903026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387205f-8194-45da-a916-5ac712e7f4d0 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:26.903750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387205f-8194-45da-a916-5ac712e7f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:26.903750 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387205f-8194-45da-a916-5ac712e7f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:26.925144 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-a387205f-8194-45da-a916-5ac712e7f4d0 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:26.926322 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-a387205f-8194-45da-a916-5ac712e7f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:26.934765 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 580/1163] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:26.942394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b5f5-c59b-4708-b60a-887de0717d15 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:26.943326 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b5f5-c59b-4708-b60a-887de0717d15 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:26.943539 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b5f5-c59b-4708-b60a-887de0717d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:26.943741 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:26.943915 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:26.944097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:26.963833 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-5406b5f5-c59b-4708-b60a-887de0717d15 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:26.965049 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-5406b5f5-c59b-4708-b60a-887de0717d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:26.965243 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:26.966346 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:26.973927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 584/1164] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:26.977949 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 581/1165] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:26.982440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:26.982643 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:26.982764 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:26.982973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:26.992972 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12215-9d96-4ccd-9ef1-928c865ae841 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:26.997737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:26.998343 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:26.998619 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:26.998888 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] PATH_INFO: `/v3/domains` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:26.999562 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88942) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:26.999866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.002108 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.006448 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:27.007686 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:27.014336 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 582/1166] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:33:27.015752 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 585/1167] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:27.022362 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.023985 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.034094 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66206-6189-466b-836d-3b3b570a0f5c None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.034298 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b23ec-da1f-4e60-ab61-fa514741c54f admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.038852 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.039006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.039459 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.039604 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.039768 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.039871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.040036 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] PATH_INFO: `/v3/domains` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.040152 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.040662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.040762 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88941) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:27.040955 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.041656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:33:27.041656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:33:27.041656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:33:27.041991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:33:27.041991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:33:27.041991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:33:27.042833 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.042938 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.056024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 586/1168] 10.222.0.50 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:33:27.064270 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.074727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865def8e-ed0f-477f-9f86-045bd15e8182 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.080081 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.080697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.080975 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.081241 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] PATH_INFO: `/v3/projects` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.081862 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.083878 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.129377 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 583/1169] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:27.133465 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.194214 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76b355-27f6-4243-91de-832daee601de admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.198894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.200120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.200120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.200120 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] PATH_INFO: `/v3/users` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.200662 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.202583 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.228296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 587/1170] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:27.232514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.284270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 584/1171] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:27.288246 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.295063 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049e2c6-9c5d-4b19-b40f-40c214f52426 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.298128 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307192-796d-489d-93e8-ca367fa165ec admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.299978 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.300587 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.300860 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.301129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.301742 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.302736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: WARNING py.warnings [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:33:27.302736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: warnings.warn(msg) Aug 23 22:33:27.302736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: Aug 23 22:33:27.303015 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.303415 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.303726 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.303994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.304105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.304679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.306271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.317026 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 585/1172] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:27.323249 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.333312 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b8533-cbdd-4a4c-b19d-5b3436ac4f08 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.337834 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.338505 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.338685 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.338950 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.339600 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.341159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.352442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 586/1173] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:27.356540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.366529 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a03ae-ac53-42fe-8b21-e38bc489d359 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.371200 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.371873 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] REQUEST_METHOD: `PUT` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.372152 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.372420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] PATH_INFO: `/v3/projects/90ae880250164cdc822e61430a8faa77/users/acd379117aa9412582b4b5755dd897ad/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.386942 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae880250164cdc822e61430a8faa77, user_id=acd379117aa9412582b4b5755dd897ad, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.387985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: WARNING py.warnings [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:33:27.387985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: warnings.warn(msg) Aug 23 22:33:27.387985 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: Aug 23 22:33:27.389917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e80859-61d1-4fc4-9f0a-4834a3c52617 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.403143 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 588/1174] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:27.408744 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.417751 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b9182-fb00-436e-8972-51ec43cf15ea admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.422870 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.423549 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.423832 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.424131 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.424758 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.426380 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.436363 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 589/1175] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:27.442297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.452315 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e443c98-7eab-4889-9d04-cf499032b0ed admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.457273 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.462755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.462755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.462755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.462755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.462755 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.465314 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 587/1176] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:27 2022] PUT /identity/v3/projects/90ae880250164cdc822e61430a8faa77/users/acd379117aa9412582b4b5755dd897ad/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:27.471707 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.471997 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.472319 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.472430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 590/1177] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:33:27.476606 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.487427 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ae40-9332-442f-a238-e9f6a9eb0123 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.493645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:27.494860 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:27.545396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:27.546058 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.546723 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.546998 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.547925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] PATH_INFO: `/v3/projects/15bb1116e839479f9e5bfca1adb997a3/users/b6ebb2958a9c4a168672fda34dc98e95/roles/2024dabf177244f1926c4f4a4f9efacc` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.557502 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 588/1178] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:27.562996 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15bb1116e839479f9e5bfca1adb997a3, user_id=b6ebb2958a9c4a168672fda34dc98e95, role_id=2024dabf177244f1926c4f4a4f9efacc)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.565818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd567979-0832-4cf0-9800-4e031bea777a admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.568004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.569388 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:27.627587 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57267c4a-d866-47ca-9c63-9f4ea9ebc813 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.631328 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.631974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.632249 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.632520 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.641762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.643139 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 591/1179] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:27 2022] PUT /identity/v3/projects/15bb1116e839479f9e5bfca1adb997a3/users/b6ebb2958a9c4a168672fda34dc98e95/roles/2024dabf177244f1926c4f4a4f9efacc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:27.643269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.648250 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafdb40-c7c8-43f2-854b-b53353d40298 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.648530 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafdb40-c7c8-43f2-854b-b53353d40298 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.648799 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafdb40-c7c8-43f2-854b-b53353d40298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.654097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 589/1180] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:27.657582 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:27.674020 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-feafdb40-c7c8-43f2-854b-b53353d40298 None None] MFA Rules not processed for user `ed7003dd4df247c4b85cea0f6834c0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:27.675241 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-feafdb40-c7c8-43f2-854b-b53353d40298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:27.733927 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 592/1181] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:27.744943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:27.754329 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6818c-5b1c-49a5-bc0b-737b33a3a36b service neutron] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:27.805171 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:27.805788 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:27.806065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:27.806354 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:27.816782 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:27.818211 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:27.828019 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 590/1182] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:34.028072 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.028625 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.029230 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.082394 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] MFA Rules not processed for user `b6ebb2958a9c4a168672fda34dc98e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:34.084906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:34.208297 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 593/1183] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:34.212385 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.228018 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d61792-d1e7-4900-9597-5d501923266d service neutron] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:34.233825 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:34.234690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.235189 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.235672 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.236462 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:34.238639 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:34.372038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 591/1184] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:34.376668 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.393728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825af0c-fdc6-4d51-b9cc-6339d5c278d4 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:34.497991 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:34.498943 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.499769 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.500240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.501848 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:34.504313 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:34.639733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 594/1185] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:34 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:34.644363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.664263 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d53da-b60e-4690-9b0c-9daf3e85a2dc admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:34.670669 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:34.671414 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.673363 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.680722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.683450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:34.685811 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989c4f-6b0c-4b7c-a098-5064f6f4dea9 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:34.704488 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 592/1186] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:34.708876 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.720452 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd953c90-cd59-42a0-b0f0-4f91372ae5aa admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:34.734004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.734004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.734004 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.737818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:34.738513 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:34.738792 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:34.739809 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] PATH_INFO: `/v3/projects/4b4c8a74415a4149bda2dc8130d6008d/users/4add6df73f0345b4b56f9f80f509ff35/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:34.758784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4c8a74415a4149bda2dc8130d6008d, user_id=4add6df73f0345b4b56f9f80f509ff35, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:34.762286 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:34.769838 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] MFA Rules not processed for user `acd379117aa9412582b4b5755dd897ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:34.771744 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:34.847227 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:34.852149 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 593/1187] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:34 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:34.856395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.866982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:34.872906 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 595/1188] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:34 2022] PUT /identity/v3/projects/4b4c8a74415a4149bda2dc8130d6008d/users/4add6df73f0345b4b56f9f80f509ff35/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:34.877005 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:34.878814 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfe89f-f2a1-422b-bfbd-8e4f82448706 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:34.997870 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b333a4c-0fba-4587-9e98-ee2dce02dd96 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.003741 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.004736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.005234 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.005515 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.006167 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.007941 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.023003 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 596/1189] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:35.027446 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.037511 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.038154 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.044421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.044421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.044421 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.045047 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db51-a7b7-4ea1-ae7b-f0c0bebd8d5b admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.045554 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.046584 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.047388 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.047734 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.048075 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] PATH_INFO: `/v3/projects/4b4c8a74415a4149bda2dc8130d6008d/users/4add6df73f0345b4b56f9f80f509ff35/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.050296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4c8a74415a4149bda2dc8130d6008d, user_id=4add6df73f0345b4b56f9f80f509ff35, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.053106 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.071621 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 597/1190] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:35 2022] PUT /identity/v3/projects/4b4c8a74415a4149bda2dc8130d6008d/users/4add6df73f0345b4b56f9f80f509ff35/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:35.177238 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 594/1191] 10.222.0.50 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:34 2022] POST /identity/v3/projects => generated 381 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:35.181274 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.273818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0eacc-50c1-486f-af40-272246420e3d admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.339945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.340591 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.340921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.347221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.347984 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.350135 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.483156 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 598/1192] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:35 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:35.488261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.500151 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6d5a-0377-4e9a-9ba0-13601b85bb59 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.507855 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.508724 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.509204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.509955 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.511326 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.527707 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.546568 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 595/1193] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:35.551372 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.566429 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005800-e543-490b-af82-86600030c4d9 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.573357 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.574064 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.574418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.574701 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] PATH_INFO: `/v3/projects/75548c1c8354436bb94581435e620bb0/users/19876fe713c044d2b6e6708353770016/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.597038 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75548c1c8354436bb94581435e620bb0, user_id=19876fe713c044d2b6e6708353770016, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.600206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.603533 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:35.701262 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 599/1194] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:35 2022] PUT /identity/v3/projects/75548c1c8354436bb94581435e620bb0/users/19876fe713c044d2b6e6708353770016/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:35.706805 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.720562 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dca6b-227d-4f50-9b13-d7753d35befd admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.808671 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.809449 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.810013 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.810365 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.811116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.812880 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced415f1-e2cd-49ed-a6f3-c51efb5a8f90 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.826248 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 596/1195] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:35.831352 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.849050 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed612f-eec7-4c3a-9876-e58cdb00b65d admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.861085 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.861865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] REQUEST_METHOD: `PUT` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.862154 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.862428 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] PATH_INFO: `/v3/projects/75548c1c8354436bb94581435e620bb0/users/19876fe713c044d2b6e6708353770016/roles/9acf470ec24e45b6bdfefacf12e6b0a5` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.866440 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75548c1c8354436bb94581435e620bb0, user_id=19876fe713c044d2b6e6708353770016, role_id=9acf470ec24e45b6bdfefacf12e6b0a5)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.869473 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.888921 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 600/1196] 10.222.0.50 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:35 2022] PUT /identity/v3/projects/75548c1c8354436bb94581435e620bb0/users/19876fe713c044d2b6e6708353770016/roles/9acf470ec24e45b6bdfefacf12e6b0a5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:42.295627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df170be0-e1d3-4d3d-850b-edf206d225ca None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:42.295627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df170be0-e1d3-4d3d-850b-edf206d225ca None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:42.295627 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df170be0-e1d3-4d3d-850b-edf206d225ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:42.341722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-df170be0-e1d3-4d3d-850b-edf206d225ca None None] MFA Rules not processed for user `4add6df73f0345b4b56f9f80f509ff35`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:42.343658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-df170be0-e1d3-4d3d-850b-edf206d225ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:42.455861 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:42.480204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 597/1197] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:42 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:42.515362 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:42.517438 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:42.609631 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f17c45-43cb-4774-b09f-1140767a6020 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:42.617052 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f428da0321f49fa81fa70bcdddeaf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:42.617857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:42.618552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:42.618552 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:42.705537 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:42.707532 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:42.732526 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 601/1198] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:42 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:43.306005 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076266-dcf8-438a-9203-f969a1a15f49 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:43.307316 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076266-dcf8-438a-9203-f969a1a15f49 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:43.307889 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54076266-dcf8-438a-9203-f969a1a15f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:43.363656 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-54076266-dcf8-438a-9203-f969a1a15f49 None None] MFA Rules not processed for user `19876fe713c044d2b6e6708353770016`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:43.365259 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-54076266-dcf8-438a-9203-f969a1a15f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:43.459679 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 598/1199] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:43 2022] POST /identity/v3/auth/tokens => generated 2885 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:43.473186 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:43.482296 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10505a89-d89d-4a36-829b-ddc113bb0d6a service glance] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:43.487024 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f428da0321f49fa81fa70bcdddeaf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:43.487784 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:43.488066 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:43.488341 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:43.582905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:43.584402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d9114-283c-49d7-b9a8-16a14d52e7f6 service glance] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:43.599706 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 602/1200] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:43 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:53.410175 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270221c-11ea-483b-94d7-3e1db4cb96e1 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.410766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270221c-11ea-483b-94d7-3e1db4cb96e1 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.410766 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270221c-11ea-483b-94d7-3e1db4cb96e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.430398 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-6270221c-11ea-483b-94d7-3e1db4cb96e1 None None] MFA Rules not processed for user `acd379117aa9412582b4b5755dd897ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:53.431634 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-6270221c-11ea-483b-94d7-3e1db4cb96e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.438752 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 599/1201] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:33:53 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:53.590237 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:INSERT=2,keystone:SELECT=83 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:53.738961 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b55b6f-9598-4f32-9e0d-cb7522b91bd2 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.739240 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b55b6f-9598-4f32-9e0d-cb7522b91bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.739531 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b55b6f-9598-4f32-9e0d-cb7522b91bd2 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.740858 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 603/1202] 10.222.0.50 () {54 vars in 962 bytes} [Tue Aug 23 22:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:33:53.747762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ba0b-5ab6-4c2d-ae1e-c202c6623282 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.748269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ba0b-5ab6-4c2d-ae1e-c202c6623282 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.748542 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ba0b-5ab6-4c2d-ae1e-c202c6623282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.770442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-f1d0ba0b-5ab6-4c2d-ae1e-c202c6623282 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:53.772012 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-f1d0ba0b-5ab6-4c2d-ae1e-c202c6623282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.860180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 600/1203] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Aug 23 22:33:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:53.865654 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.866034 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.866327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.867692 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 604/1204] 10.222.0.50 () {54 vars in 912 bytes} [Tue Aug 23 22:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:33:53.872867 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb90f0-5286-43d7-95d7-09d16b94f37c None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.873195 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb90f0-5286-43d7-95d7-09d16b94f37c None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.873476 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb90f0-5286-43d7-95d7-09d16b94f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.895469 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e1cb90f0-5286-43d7-95d7-09d16b94f37c None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:53.896737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e1cb90f0-5286-43d7-95d7-09d16b94f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.907131 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 601/1205] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Aug 23 22:33:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:53.918221 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:53.920360 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:53.933875 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb43b8a-ef16-47e2-bcd9-dad4383f608b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:53.937683 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f428da0321f49fa81fa70bcdddeaf3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:53.938367 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:53.938642 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:53.939719 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:53.949845 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:53.951288 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32119833-c393-4005-9d13-cd0a52d99e2d service glance] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:53.962493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 605/1206] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:54.322615 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fe19-0ade-41be-94b0-b646ea468c51 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:54.322905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fe19-0ade-41be-94b0-b646ea468c51 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:54.323180 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fe19-0ade-41be-94b0-b646ea468c51 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:54.324571 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 602/1207] 10.222.0.50 () {54 vars in 912 bytes} [Tue Aug 23 22:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:33:54.330215 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bbd0-e703-4975-bea7-3d0754ab70b0 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:54.330502 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bbd0-e703-4975-bea7-3d0754ab70b0 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:54.330783 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944bbd0-e703-4975-bea7-3d0754ab70b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:54.351226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-a944bbd0-e703-4975-bea7-3d0754ab70b0 None None] MFA Rules not processed for user `b7eebced2e1c452abe1bd93520f0f6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:54.352608 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-a944bbd0-e703-4975-bea7-3d0754ab70b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:54.408197 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 606/1208] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Aug 23 22:33:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:54.419389 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fe19-0ade-41be-94b0-b646ea468c51 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:54.431001 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fe19-0ade-41be-94b0-b646ea468c51 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:54.434574 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:54.435234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:54.435624 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:54.435897 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:54.443928 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:54.445361 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359af60b-50cf-465e-b401-1591937f305d service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:54.453261 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 603/1209] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:54.987890 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289d02-69ae-4afa-9271-df9de2c37d05 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:54.988361 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289d02-69ae-4afa-9271-df9de2c37d05 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:54.988648 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea289d02-69ae-4afa-9271-df9de2c37d05 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:54.990410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 607/1210] 10.222.0.50 () {54 vars in 962 bytes} [Tue Aug 23 22:33:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:33:54.997834 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30e26-f7ab-4607-a1d7-45ecc13df564 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:54.998117 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30e26-f7ab-4607-a1d7-45ecc13df564 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:54.998407 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30e26-f7ab-4607-a1d7-45ecc13df564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.013022 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae2f7e-5f1b-443f-90a8-d61bc94a6641 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.021929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae2f7e-5f1b-443f-90a8-d61bc94a6641 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.021929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae2f7e-5f1b-443f-90a8-d61bc94a6641 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.021929 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 608/1211] 10.222.0.50 () {54 vars in 961 bytes} [Tue Aug 23 22:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:33:55.022253 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-43b30e26-f7ab-4607-a1d7-45ecc13df564 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:55.022671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.023165 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-43b30e26-f7ab-4607-a1d7-45ecc13df564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:55.023353 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.023908 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.033871 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 604/1212] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Aug 23 22:33:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:55.039841 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb86-c315-4164-9ab1-bba2d7a0ed01 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.040125 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb86-c315-4164-9ab1-bba2d7a0ed01 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.040396 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0eb86-c315-4164-9ab1-bba2d7a0ed01 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.042205 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 605/1213] 10.222.0.50 () {54 vars in 912 bytes} [Tue Aug 23 22:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:33:55.052034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.052034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.052034 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.052335 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:55.052853 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:55.075742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:55.077065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:55.090681 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 606/1214] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Aug 23 22:33:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:55.099302 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:55.108872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51877a-479d-4b5b-bb62-3b4d0e6e8c08 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:55.113946 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:55.114668 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.115159 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.121566 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.139232 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:55.140994 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bc38c-b354-4bb6-b50f-9124ec7587fd service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:55.153945 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 609/1215] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Aug 23 22:33:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:55.161051 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 607/1216] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:55.167307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:55.181808 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee2aaf-5f42-4f25-ace3-d9bfc7127945 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:55.186982 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:55.187674 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:55.196206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:55.196206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:55.196206 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:55.203255 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:55.204988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:55.217905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 610/1217] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:05.148762 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=90 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:05.212409 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=64 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:07.404617 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf56a-3ee0-43d5-aec1-6e4306ce0315 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:07.405204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf56a-3ee0-43d5-aec1-6e4306ce0315 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:07.405204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbf56a-3ee0-43d5-aec1-6e4306ce0315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:07.429749 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-11bbf56a-3ee0-43d5-aec1-6e4306ce0315 None None] MFA Rules not processed for user `b7eebced2e1c452abe1bd93520f0f6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:07.431037 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-11bbf56a-3ee0-43d5-aec1-6e4306ce0315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:07.438751 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 608/1218] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 23 22:34:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:07.451321 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:07.461688 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373d4b-bff3-421e-ab95-ac259d208412 service placement] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:07.465303 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:07.465916 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:07.466192 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:07.466460 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:07.474293 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:07.475844 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf109-6f42-47fe-95a1-c7c06ee15f23 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:07.484598 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 611/1219] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:08.311202 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7edea5-0b43-4ec1-ad69-a102fe7211db None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:08.311561 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7edea5-0b43-4ec1-ad69-a102fe7211db None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:08.311952 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7edea5-0b43-4ec1-ad69-a102fe7211db None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:08.313645 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 609/1220] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:34:08.333672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6267c44-e315-49d5-bddd-10d016f49d25 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:08.333672 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6267c44-e315-49d5-bddd-10d016f49d25 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:08.333971 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6267c44-e315-49d5-bddd-10d016f49d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:08.355156 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-d6267c44-e315-49d5-bddd-10d016f49d25 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:08.356406 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-d6267c44-e315-49d5-bddd-10d016f49d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:08.366306 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 612/1221] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:08.388081 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7edea5-0b43-4ec1-ad69-a102fe7211db None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:08.407531 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7edea5-0b43-4ec1-ad69-a102fe7211db None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:08.415969 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:08.417132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:08.417625 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:08.418418 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:08.430743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:08.433894 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e6923-f425-492d-be2e-9e15e93d90a3 service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:08.459548 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 610/1222] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:08 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:15.922294 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937083-e8cf-4a42-a2e6-e01c131d4aaa None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:15.922922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937083-e8cf-4a42-a2e6-e01c131d4aaa None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:15.922922 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937083-e8cf-4a42-a2e6-e01c131d4aaa None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:15.924417 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 613/1223] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:34:16.033133 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:16.034170 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:16.034655 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:16.057779 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:16.059064 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:16.069054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 611/1224] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:16.082980 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45937083-e8cf-4a42-a2e6-e01c131d4aaa None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:16.098925 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45937083-e8cf-4a42-a2e6-e01c131d4aaa None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:16.123905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:16.123905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:16.123905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:16.123905 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:16.138988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:16.138988 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2bba8-b56c-4232-9ae8-53cb325da103 service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:16.148365 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 614/1225] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:26.052722 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=12 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:26.142727 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=15 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:36.123836 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:36.134434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8b1a-3eb9-4e9f-a13c-243a7106c5e3 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:36.138053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:36.138657 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:36.138940 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:36.139212 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:36.150045 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:36.151663 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ee834-2a29-4d59-a653-d016f8ddd1d0 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:36.161982 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 612/1226] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:36 2022] GET /identity/v3/auth/tokens => generated 2885 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:45.379627 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3661-0034-48fb-8094-b612410572f8 None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.381160 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3661-0034-48fb-8094-b612410572f8 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.381919 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3661-0034-48fb-8094-b612410572f8 None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.387652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 615/1227] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:34:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:34:45.566891 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2413-7a5d-41a8-9186-79c09925de5a None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.567918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2413-7a5d-41a8-9186-79c09925de5a None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.568224 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2413-7a5d-41a8-9186-79c09925de5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.593707 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-8aac2413-7a5d-41a8-9186-79c09925de5a None None] MFA Rules not processed for user `64a888930adc468c9fbeaa51913de637`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:45.596337 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-8aac2413-7a5d-41a8-9186-79c09925de5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.609496 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 613/1228] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:34:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:45.654225 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3661-0034-48fb-8094-b612410572f8 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.682725 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3661-0034-48fb-8094-b612410572f8 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.687939 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.689897 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.690419 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.690756 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.701105 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.705129 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e611a15-a73e-43cf-992e-0eaa127f403d service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.715615 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 616/1229] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:55.587806 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=9 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:55.710983 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=6 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:52.283143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:52.283866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:52.283866 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:52.317000 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] MFA Rules not processed for user `b6ebb2958a9c4a168672fda34dc98e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:52.318623 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:52.346743 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 614/1230] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:35:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:52.722170 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9002b4-26b6-49db-9909-30ac2345dfd3 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:52.723055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9002b4-26b6-49db-9909-30ac2345dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:52.723055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9002b4-26b6-49db-9909-30ac2345dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:52.811195 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-6f9002b4-26b6-49db-9909-30ac2345dfd3 None None] MFA Rules not processed for user `b7eebced2e1c452abe1bd93520f0f6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:52.812483 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-6f9002b4-26b6-49db-9909-30ac2345dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:52.853454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 617/1231] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Aug 23 22:35:52 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:52.868974 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:52.879569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af711a-c718-4950-b886-dbb5ae3f6b3c None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:52.884240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:52.885057 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:52.885406 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:52.885773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:52.896110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:52.897718 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4929e7d-3aa2-4485-8f77-5e885e59d0f0 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:52.906877 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 615/1232] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:02.849177 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=33 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:02.902989 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=21 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:35.739384 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:35.740080 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:35.740277 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:35.774450 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] MFA Rules not processed for user `b6ebb2958a9c4a168672fda34dc98e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:35.776602 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:35.788564 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 618/1233] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:36:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:36:45.766559 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=3 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:58.961150 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324848-d834-45bb-ae86-8812a1d86fb4 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:58.961886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324848-d834-45bb-ae86-8812a1d86fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:58.961886 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8324848-d834-45bb-ae86-8812a1d86fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:58.986626 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-e8324848-d834-45bb-ae86-8812a1d86fb4 None None] MFA Rules not processed for user `b6ebb2958a9c4a168672fda34dc98e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:36:58.988038 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-e8324848-d834-45bb-ae86-8812a1d86fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:58.996696 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 616/1234] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:36:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:37:02.020264 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:02.074492 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e3d2d-c0f8-4db1-a9a2-8bab53ddc210 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:02.082656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:02.083467 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:02.083870 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:02.084229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:02.095338 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:02.097332 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:02.110841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 619/1235] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:37:08.979234 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=3 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:12.105325 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=13 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:41.235670 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:41.236269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:41.236269 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:41.256773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] MFA Rules not processed for user `acd379117aa9412582b4b5755dd897ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:41.258009 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:41.265395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 617/1236] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:38:41 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:42.379997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:42.458859 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15bce8-4fe9-4ff0-b109-2d693310938e service placement] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:42.463851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b13ed7288ab43e08f7b842927e77d6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:42.464464 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:42.464736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:42.465269 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:42.480736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:42.483977 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59078e6-8c0e-405a-87e6-8524342d8027 service cinder] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:42.499993 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 620/1237] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:42 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:43.194824 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:43.223890 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c485fe-b846-4240-a1ea-bb5cee3476f9 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:43.229033 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:43.229664 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:43.229941 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:43.230207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:43.240719 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:43.242885 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:43.252998 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 618/1238] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:43 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:43.711456 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:43.712065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:43.712065 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:43.732687 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] MFA Rules not processed for user `b6ebb2958a9c4a168672fda34dc98e95`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:38:43.733934 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:38:43.741733 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 621/1239] 10.222.0.50 () {58 vars in 958 bytes} [Tue Aug 23 22:38:43 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:38:53.248019 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=13 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:53.727019 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=33 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:54.125138 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:54.141006 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22433c-9e9e-49b5-811a-8a04cd01e2cd service nova] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:54.147478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:54.148612 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:54.149110 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:54.149638 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:54.167076 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:54.168773 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:54.181207 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 619/1240] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:38:55.498410 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:38:55.512886 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a79c0-112a-4246-8ff2-054d5dc9997b None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:38:55.518857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:38:55.519917 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:38:55.520203 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:38:55.520476 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:38:55.533055 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:38:55.537697 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:38:55.552878 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 622/1241] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:38:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:39:04.176360 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=6 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:05.544930 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=6 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:07.782872 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:07.792404 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff7634-bcbf-4476-9b4d-04589bb83779 service neutron] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:07.796896 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:07.797540 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:07.797819 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:07.798092 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:07.806345 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:07.807924 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:07.817742 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 620/1242] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:10.376402 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:10.385956 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8075c-a545-49a1-8f93-310dcda3d31f service neutron] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:10.390761 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:10.391514 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:10.391970 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:10.392381 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:10.403938 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:10.407094 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:10.419327 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 623/1243] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:10 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:12.965812 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:12.984787 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b5ba-1ea5-426c-a0a5-3f0c0859581e service neutron] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:12.991141 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:12.992054 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:12.992556 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:12.992889 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:13.006162 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:13.008584 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:13.021384 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 621/1244] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:20.414168 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=6 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:23.016325 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=12 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:26.078284 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:40:26.091612 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857596c9-d176-4d09-951d-e3e9bbef07b1 service neutron] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:40:26.104619 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64a888930adc468c9fbeaa51913de637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:40:26.106973 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:26.107454 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:26.107967 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:26.127757 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:40:26.133449 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e15d65-b8a8-4efc-9905-401d8fc1ffbb service nova] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:40:26.154035 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 624/1245] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:40:26 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:40:36.141653 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=6 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:49.161097 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:40:49.172497 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45998c60-51e1-42dd-bc82-747d986b30af service nova] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:40:49.176358 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:40:49.176905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:49.177177 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:49.177442 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:49.268143 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:40:49.271053 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe05a-79f5-4097-b46d-5f71a070bd7d service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:40:49.310226 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 622/1246] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:40:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:40:54.388122 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b962d-485d-46ed-a869-62442e97499d None None] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:54.388989 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b962d-485d-46ed-a869-62442e97499d None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:54.389196 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b962d-485d-46ed-a869-62442e97499d None None] PATH_INFO: `/` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:54.390972 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 625/1247] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:40:54.401690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a551-e0d4-4cc6-abc9-a2f8cb96c4bb None None] REQUEST_METHOD: `POST` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:54.408513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a551-e0d4-4cc6-abc9-a2f8cb96c4bb None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:54.408513 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a551-e0d4-4cc6-abc9-a2f8cb96c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:54.487964 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.auth.core [None req-1833a551-e0d4-4cc6-abc9-a2f8cb96c4bb None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88942) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:40:54.490116 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-1833a551-e0d4-4cc6-abc9-a2f8cb96c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:40:54.505895 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 623/1248] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:40:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:40:54.522258 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b962d-485d-46ed-a869-62442e97499d None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:40:54.538119 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b962d-485d-46ed-a869-62442e97499d None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:40:54.544685 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:40:54.545318 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:54.545656 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:54.545968 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:54.556708 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:40:54.558632 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e484d-00c8-440b-92d3-f800dcdfb6a6 service placement] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:40:54.570782 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 626/1249] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:40:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:40:59.427087 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce8a1-8940-4292-b52e-b94717dec147 None None] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:59.427906 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce8a1-8940-4292-b52e-b94717dec147 None None] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:59.428408 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce8a1-8940-4292-b52e-b94717dec147 None None] PATH_INFO: `/` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:59.432055 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 624/1250] 10.222.0.50 () {54 vars in 921 bytes} [Tue Aug 23 22:40:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:40:59.444931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] REQUEST_METHOD: `POST` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:59.444931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:59.444931 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:59.482593 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.auth.core [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] MFA Rules not processed for user `1aec380fe79b477e907cc777efab1018`. Rule list: `[]` (Enabled: `True`). {{(pid=88941) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:40:59.484715 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:40:59.500630 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 627/1251] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Aug 23 22:40:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:40:59.515905 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce8a1-8940-4292-b52e-b94717dec147 None None] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:40:59.533186 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce8a1-8940-4292-b52e-b94717dec147 None None] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:40:59.539409 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:40:59.540145 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:59.540466 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:59.540777 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:59.550192 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:40:59.551917 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:40:59.564204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 625/1252] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:40:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:40:59.625030 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:40:59.648146 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86e3cd-5824-4f1d-a0bc-1a4a6d1bfa27 None None] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:40:59.653569 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:40:59.662675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:40:59.662675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:40:59.662675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] PATH_INFO: `/v3/users/acd379117aa9412582b4b5755dd897ad` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:40:59.662675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd379117aa9412582b4b5755dd897ad)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:40:59.662675 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:40:59.916004 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd379117aa9412582b4b5755dd897ad'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:40:59.916869 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd379117aa9412582b4b5755dd897ad'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.007736 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd379117aa9412582b4b5755dd897ad'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.025818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd379117aa9412582b4b5755dd897ad'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.035156 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd379117aa9412582b4b5755dd897ad'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.042903 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 628/1253] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 23 22:40:59 2022] DELETE /identity/v3/users/acd379117aa9412582b4b5755dd897ad => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:00.387700 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:00.409347 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d710a6-846f-48f6-a61e-1ae7b4bc9a67 service placement] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:00.501164 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:00.502096 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:00.502514 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:00.502922 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] PATH_INFO: `/v3/projects/90ae880250164cdc822e61430a8faa77` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:00.504883 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ae880250164cdc822e61430a8faa77)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:00.509069 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:00.812132 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:00.823187 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ae880250164cdc822e61430a8faa77', 'request_id': 'req-0d405cad-c2a4-4f65-86d4-2ef75e653631'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.828828 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ae880250164cdc822e61430a8faa77', 'request_id': 'req-0d405cad-c2a4-4f65-86d4-2ef75e653631'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:00.835874 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ae880250164cdc822e61430a8faa77', 'request_id': 'req-0d405cad-c2a4-4f65-86d4-2ef75e653631'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.028431 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] The token cache is being invalidate because project 90ae880250164cdc822e61430a8faa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:01.028739 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.029967 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.031410 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 626/1254] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:00 2022] DELETE /identity/v3/projects/90ae880250164cdc822e61430a8faa77 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:01.037079 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:01.039330 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:01.057609 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e6d4-2775-4808-9edb-c811fd58f167 admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:01.158670 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:01.159684 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:01.160178 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:01.160615 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] PATH_INFO: `/v3/users/19876fe713c044d2b6e6708353770016` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:01.162493 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=19876fe713c044d2b6e6708353770016)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:01.166017 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:01.494307 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19876fe713c044d2b6e6708353770016'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.494997 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19876fe713c044d2b6e6708353770016'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.613840 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19876fe713c044d2b6e6708353770016'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.618229 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:01.633831 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19876fe713c044d2b6e6708353770016'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.641818 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19876fe713c044d2b6e6708353770016'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:01.649393 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 629/1255] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:01 2022] DELETE /identity/v3/users/19876fe713c044d2b6e6708353770016 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:01.985475 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:01.988080 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:02.011240 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d405cad-c2a4-4f65-86d4-2ef75e653631 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:02.120271 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:02.121399 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:02.121918 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:02.122395 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] PATH_INFO: `/v3/projects/75548c1c8354436bb94581435e620bb0` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:02.124515 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75548c1c8354436bb94581435e620bb0)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:02.128323 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:02.301712 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75548c1c8354436bb94581435e620bb0', 'request_id': 'req-4315f9cd-f717-425f-8987-169b85d81ba8'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:02.309268 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75548c1c8354436bb94581435e620bb0', 'request_id': 'req-4315f9cd-f717-425f-8987-169b85d81ba8'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:02.318065 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75548c1c8354436bb94581435e620bb0', 'request_id': 'req-4315f9cd-f717-425f-8987-169b85d81ba8'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:02.442168 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] The token cache is being invalidate because project 75548c1c8354436bb94581435e620bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:02.442478 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:02.443210 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:02.445658 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 627/1256] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:01 2022] DELETE /identity/v3/projects/75548c1c8354436bb94581435e620bb0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:11.813950 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:12.438270 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:35.635329 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:35.639581 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:35.716176 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281add1-3f75-4277-9c20-4c0226fbf2fa admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:35.789671 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aec380fe79b477e907cc777efab1018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:35.790305 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] REQUEST_METHOD: `GET` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:35.790578 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:35.790846 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:35.792810 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:35.805437 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:35.807074 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:35.818512 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 630/1257] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:45.813652 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=58 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:47.142217 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:47.143761 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:47.208577 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315f9cd-f717-425f-8987-169b85d81ba8 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:47.212293 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7eebced2e1c452abe1bd93520f0f6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca8fa9fc80a41988acf49070a58c714', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:47.212912 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] REQUEST_METHOD: `GET` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:47.213184 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:47.213450 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:47.215204 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:47.287732 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:47.290422 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:47.306043 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 628/1258] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:56.349363 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:56.353301 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:56.374232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f04089-7e94-42f9-9fad-10429e7695a8 service placement] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:56.379430 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:56.380117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:56.380389 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:56.380728 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] PATH_INFO: `/v3/users/b6ebb2958a9c4a168672fda34dc98e95` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:56.382117 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ebb2958a9c4a168672fda34dc98e95)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:56.384161 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:56.586857 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ebb2958a9c4a168672fda34dc98e95'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:56.587585 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ebb2958a9c4a168672fda34dc98e95'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:56.672841 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ebb2958a9c4a168672fda34dc98e95'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:56.688266 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ebb2958a9c4a168672fda34dc98e95'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:56.697418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ebb2958a9c4a168672fda34dc98e95'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:56.704115 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 631/1259] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:56 2022] DELETE /identity/v3/users/b6ebb2958a9c4a168672fda34dc98e95 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:57.009320 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:57.020569 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065140b7-8b8e-4222-9493-e7b342621c11 service neutron] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:57.101896 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:57.102555 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:57.102839 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:57.103114 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] PATH_INFO: `/v3/projects/15bb1116e839479f9e5bfca1adb997a3` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:57.104420 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15bb1116e839479f9e5bfca1adb997a3)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:57.106423 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:57.239239 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15bb1116e839479f9e5bfca1adb997a3', 'request_id': 'req-d51b3ece-b4de-4959-99fc-680c8ba23fe5'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.241489 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:57.245737 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15bb1116e839479f9e5bfca1adb997a3', 'request_id': 'req-d51b3ece-b4de-4959-99fc-680c8ba23fe5'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.252394 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15bb1116e839479f9e5bfca1adb997a3', 'request_id': 'req-d51b3ece-b4de-4959-99fc-680c8ba23fe5'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.426771 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] The token cache is being invalidate because project 15bb1116e839479f9e5bfca1adb997a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:57.427089 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.427813 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.429386 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 629/1260] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:57 2022] DELETE /identity/v3/projects/15bb1116e839479f9e5bfca1adb997a3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:57.433625 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Authenticating user token {{(pid=88941) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:57.435851 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.fernet_utils [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88941) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:57.448607 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f5146-c38c-4b44-b55d-e99cd8c6ca7c admin admin] Validating token access rules against request {{(pid=88941) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:57.512205 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88941) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:57.512750 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:57.513021 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] SCRIPT_NAME: `/identity` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:57.513287 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] PATH_INFO: `/v3/users/4add6df73f0345b4b56f9f80f509ff35` {{(pid=88941) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:57.514414 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4add6df73f0345b4b56f9f80f509ff35)` {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:57.516418 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] RBAC: Authorization granted {{(pid=88941) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:57.790232 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4add6df73f0345b4b56f9f80f509ff35'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.790865 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4add6df73f0345b4b56f9f80f509ff35'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.935243 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4add6df73f0345b4b56f9f80f509ff35'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.949759 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4add6df73f0345b4b56f9f80f509ff35'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.951872 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:57.958226 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG keystone.notifications [None req-4a0c1b34-cbd0-4600-8989-e71b23550efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4add6df73f0345b4b56f9f80f509ff35'} {{(pid=88941) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:57.964686 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: [pid: 88941|app: 0|req: 632/1261] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:57 2022] DELETE /identity/v3/users/4add6df73f0345b4b56f9f80f509ff35 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:58.302943 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Authenticating user token {{(pid=88942) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:58.304438 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.fernet_utils [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88942) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:58.319879 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b3ece-b4de-4959-99fc-680c8ba23fe5 admin admin] Validating token access rules against request {{(pid=88942) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:58.381112 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed7003dd4df247c4b85cea0f6834c0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91d06c9416144a16ae9ac55e441f6e94', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88942) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:58.381754 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:58.382028 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:58.382297 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] PATH_INFO: `/v3/projects/4b4c8a74415a4149bda2dc8130d6008d` {{(pid=88942) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:58.383433 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4c8a74415a4149bda2dc8130d6008d)` {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:58.385434 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] RBAC: Authorization granted {{(pid=88942) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:58.548589 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4c8a74415a4149bda2dc8130d6008d', 'request_id': 'req-2facee17-0e13-4a8e-a366-cfa8d1f99318'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:58.554452 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4c8a74415a4149bda2dc8130d6008d', 'request_id': 'req-2facee17-0e13-4a8e-a366-cfa8d1f99318'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:58.561803 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4c8a74415a4149bda2dc8130d6008d', 'request_id': 'req-2facee17-0e13-4a8e-a366-cfa8d1f99318'} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:58.683690 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] The token cache is being invalidate because project 4b4c8a74415a4149bda2dc8130d6008d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88942) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:58.683957 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:58.684609 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG keystone.notifications [None req-2facee17-0e13-4a8e-a366-cfa8d1f99318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88942) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:58.686100 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: [pid: 88942|app: 0|req: 630/1262] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:58 2022] DELETE /identity/v3/projects/4b4c8a74415a4149bda2dc8130d6008d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:43:08.335234 dv-osbrick-849840-7-ceph devstack@keystone.service[88941]: DEBUG dbcounter [-] [88941] Writing DB stats keystone:SELECT=4 {{(pid=88941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:08.680339 dv-osbrick-849840-7-ceph devstack@keystone.service[88942]: DEBUG dbcounter [-] [88942] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}